-- Logs begin at Mon 2022-05-30 11:22:34 UTC, end at Mon 2022-05-30 12:26:35 UTC. -- May 30 11:57:42.146435 dv-cinder-839793-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 30 11:57:42.155530 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 11:57:42 2022] *** May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: nodename: dv-cinder-839793-13-iscsi May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: machine: x86_64 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: clock source: unix May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: pcre jit disabled May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: detected number of CPU cores: 4 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: current working directory: / May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: detected binary path: /usr/bin/uwsgi-core May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: your processes number limit is 47680 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: your memory page size is 4096 bytes May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: detected max file descriptor number: 2048 May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: lock engine: pthread robust mutexes May 30 11:57:42.157823 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: thunder lock: enabled May 30 11:57:42.158658 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 30 11:57:42.158658 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 11:57:42.202390 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: Python main interpreter initialized at 0x5629b3f1c9c0 May 30 11:57:42.202390 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: python threads support enabled May 30 11:57:42.202390 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: your server socket listen backlog is limited to 100 connections May 30 11:57:42.202390 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: your mercy for graceful operations on workers is 90 seconds May 30 11:57:42.202755 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: mapped 403077 bytes (393 KB) for 2 cores May 30 11:57:42.202830 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: *** Operational MODE: preforking *** May 30 11:57:42.203055 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: *** uWSGI is running in multiple interpreter mode *** May 30 11:57:42.203055 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: spawned uWSGI master process (pid: 103291) May 30 11:57:42.203253 dv-cinder-839793-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 30 11:57:42.203789 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: spawned uWSGI worker 1 (pid: 103292, cores: 1) May 30 11:57:42.204570 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: spawned uWSGI worker 2 (pid: 103293, cores: 1) May 30 11:57:42.204570 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 11:57:43.414913 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 11:57:43.424318 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 11:57:44.133038 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:57:44.133038 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: from cryptography.utils import int_from_bytes May 30 11:57:44.133293 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:57:44.133293 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: from cryptography.utils import int_from_bytes May 30 11:57:44.134924 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:57:44.134924 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: from cryptography.utils import int_from_bytes May 30 11:57:44.135264 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 11:57:44.135264 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: from cryptography.utils import int_from_bytes May 30 11:57:46.732826 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:57:46.733508 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:57:46.733605 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 11:57:46.733945 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:57:46.734028 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 11:57:46.734106 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:57:46.734197 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:57:46.734344 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 11:57:46.734568 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.734702 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 11:57:46.734897 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.734983 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 11:57:46.735224 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.735323 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.735548 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.735636 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.735907 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736029 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736222 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736307 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736548 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736653 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736866 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.736957 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737181 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737265 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737449 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737541 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737766 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.737862 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738047 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738138 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-13-iscsi {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738359 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738450 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738680 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-13-iscsi {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738766 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.738996 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739075 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739298 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739401 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739603 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739689 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.739939 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.740040 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.740241 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.740334 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.740557 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.740992 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.741923 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.742055 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.742162 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.742466 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.742585 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.742907 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743039 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743185 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743282 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743391 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743475 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743702 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.743791 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744034 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744174 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744356 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744440 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744661 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744756 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.744981 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745067 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745288 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745386 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-13-iscsi {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745679 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-13-iscsi {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745771 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.745990 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.746089 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.746296 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.746385 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.746608 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.746750 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747013 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747118 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747319 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747406 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747624 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747710 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.747971 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748063 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748285 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748370 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748585 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748670 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.748909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749005 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749224 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749345 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749535 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749650 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749839 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.749924 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750135 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750219 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750437 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750532 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750738 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.750836 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751050 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751163 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751351 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751457 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751601 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751687 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.751917 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752006 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752225 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752324 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752542 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752628 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752856 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.752942 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753122 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753205 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753380 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753476 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753647 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753745 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.753960 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754046 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754281 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754366 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754586 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754681 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754889 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.754974 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755192 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755288 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755497 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755585 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755801 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.755978 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756127 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756223 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756430 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756524 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756732 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.756818 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.757093 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.757838 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.757976 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758179 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758265 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758378 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758521 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758709 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.758837 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759115 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759225 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759389 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759473 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.759774 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760052 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760141 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760378 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760463 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760693 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.760780 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761008 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761092 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761325 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761412 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761630 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761723 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.761931 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762027 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762235 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762320 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762548 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762634 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762863 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.762957 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763163 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763248 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763409 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763496 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763705 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.763797 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764031 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764173 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764353 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764480 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764658 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764776 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.764962 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765097 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765267 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765380 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765564 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765866 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.765988 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766237 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766367 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766474 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766586 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766822 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.766958 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767079 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767186 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767350 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767465 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767651 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767863 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.767979 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768086 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768269 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768382 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768586 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768701 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.768904 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769017 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769209 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769322 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769514 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769634 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769817 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.769945 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770121 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770243 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770434 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770571 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770739 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.770867 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771043 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771170 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771361 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771666 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771786 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.771994 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772307 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772422 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772633 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772763 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.772983 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773148 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773286 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773481 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773616 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773795 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.773922 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774114 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774250 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774440 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774575 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774757 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.774890 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775059 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775198 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775362 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775663 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.775790 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.776045 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.776181 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.776318 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.776515 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.776791 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.777014 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.777682 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.777770 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.777849 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.777926 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778003 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778090 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778170 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778247 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778323 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778410 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778489 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778579 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778659 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778745 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.778946 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.779041 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 11:57:46.779274 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.779361 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.779613 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.779706 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.779948 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780052 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780278 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780366 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780605 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780691 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.780919 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781011 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781226 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781319 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781537 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781624 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781858 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782166 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782253 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782474 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782559 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782782 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.782877 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783099 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783192 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783410 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783503 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783732 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.783867 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784068 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784155 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784386 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784471 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784700 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.784795 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785007 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785094 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785319 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785405 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785637 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785738 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.785957 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786043 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786265 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786359 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786584 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786690 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.786930 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787038 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787239 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787336 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787554 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787656 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.787893 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788001 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788207 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788478 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788572 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788653 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788827 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.788926 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789144 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789230 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789468 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789652 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789788 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.789872 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790076 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790170 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790386 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790473 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790695 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.790781 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791000 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791099 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791309 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791403 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791616 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791702 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.791951 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792060 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792274 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792367 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792589 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792676 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792900 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.792999 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793217 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793309 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793525 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793609 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793834 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.793934 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794148 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794239 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794449 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794542 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.794847 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795052 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795138 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795358 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795455 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795656 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795742 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.795990 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796078 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796316 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796402 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796624 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796736 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.796946 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797045 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797249 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797342 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797553 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797649 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797879 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.797973 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798167 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798262 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798467 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798563 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798776 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.798867 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799081 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799174 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799384 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799470 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799691 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.799775 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800020 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800132 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800324 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800417 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800640 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.800940 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801032 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801241 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801334 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801553 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801639 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801860 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.801958 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802167 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802253 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802475 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802570 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802781 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.802867 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803091 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803176 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803401 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803485 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803710 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.803797 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.804567 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.804690 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.804907 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805005 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805240 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805328 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805550 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805637 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805879 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.805976 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806208 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806295 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806510 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806594 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806820 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.806929 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807121 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807209 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807425 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807523 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.807922 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808062 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808186 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808359 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808443 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808661 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808755 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.808964 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809050 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809266 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809358 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809568 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809662 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.809965 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810180 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810264 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810483 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810569 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810784 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.810871 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811086 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811171 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811396 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811480 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811714 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.811798 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812064 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812156 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812398 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812484 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812714 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.812807 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813034 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813125 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813345 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813431 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813656 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813740 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.813962 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814065 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814272 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814359 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814586 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814670 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814895 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.814996 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815207 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815291 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815515 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815599 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815855 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.815961 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816157 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816242 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816471 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816561 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816778 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.816872 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817097 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817183 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817399 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817484 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817713 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.817810 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818029 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818364 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818451 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818680 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818766 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.818997 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.819082 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.819308 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.819399 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.819672 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.819775 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820054 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820154 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820322 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820406 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820632 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820720 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.820941 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821033 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821257 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821348 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821565 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821650 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821879 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.821966 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822185 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822270 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822498 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822583 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822802 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.822887 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823118 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823210 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823419 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823504 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823729 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.823859 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824066 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824169 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824393 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824491 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824707 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.824793 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825015 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825109 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825415 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825636 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825719 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.825940 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826035 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826247 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826340 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826548 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826642 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826848 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.826935 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827152 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827239 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827460 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827543 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827764 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.827874 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828103 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828217 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828403 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828499 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828711 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.828806 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829014 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829315 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829418 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829614 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829719 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.829920 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830021 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830232 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830381 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830537 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830672 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830852 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.830995 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831166 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831308 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831467 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831603 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831768 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.831878 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832102 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832202 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832405 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832706 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.832793 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833005 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833111 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833307 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833394 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833611 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833696 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.833943 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834029 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834246 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834343 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834556 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834658 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834872 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.834959 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.835701 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.835798 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836045 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836153 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836393 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836480 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836702 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.836788 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837021 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837175 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837334 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837423 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837640 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837789 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.837947 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838043 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838256 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838342 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838564 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838650 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838871 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.838965 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839188 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839276 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839494 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839580 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839802 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.839933 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840130 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840217 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840433 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840520 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840741 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.840841 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.841054 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.841140 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.841377 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.841620 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.841949 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842036 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842260 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842345 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842577 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842663 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842895 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.842990 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843212 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843298 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843534 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843620 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843877 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.843978 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844210 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844295 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844513 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844616 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844820 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.844916 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845129 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845217 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845431 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845518 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845738 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.845825 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846039 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846126 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846339 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846427 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846641 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846727 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.846947 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847033 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847246 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847547 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847640 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847865 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.847966 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848170 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848257 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848475 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848579 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848773 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.848868 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849080 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849167 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849382 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849478 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849690 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849776 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.849990 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.850077 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.850359 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.850465 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.850588 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.850678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.851432 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.851529 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.851777 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.851997 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.852087 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.852352 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.852438 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.852667 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.852833 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853010 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853098 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853345 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853431 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853648 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853748 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.853970 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854058 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854272 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854359 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854574 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854674 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854876 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.854963 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855187 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855273 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855491 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855586 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855790 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.855921 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856123 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856209 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856429 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856522 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856733 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.856819 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857039 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857127 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857339 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857433 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857641 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857728 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.857941 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858035 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858250 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858337 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858555 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858648 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858854 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.858943 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859155 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859242 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859459 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859547 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859762 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.859879 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860084 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860170 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860391 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860478 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860692 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.860786 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861003 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861095 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861303 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861388 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861602 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861702 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861901 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.861987 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862205 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862292 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862508 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862607 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862805 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.862891 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863117 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863203 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863424 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863510 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863724 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.863810 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864048 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864135 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864354 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864441 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864655 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864741 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.864954 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.865041 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.865259 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.865353 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.865571 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.865689 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866154 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866250 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866503 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866619 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866824 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.866926 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867128 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867230 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867432 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867537 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867732 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.867840 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868062 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868165 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868358 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868443 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868656 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868796 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.868953 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869094 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869241 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869376 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869535 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869667 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869845 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.869989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870146 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870280 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870446 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870582 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870728 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.870865 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871030 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871184 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871347 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871489 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871653 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.871788 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872025 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872116 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872326 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872411 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872639 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872727 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.872954 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873041 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873263 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873358 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873572 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873666 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873882 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.873970 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874180 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874276 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874491 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874585 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874796 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.874889 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875110 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875204 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875412 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875505 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875711 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.875798 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876043 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876141 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876349 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876435 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876656 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876754 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.876973 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877068 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877288 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877373 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877607 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877693 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.877908 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878008 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878212 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878305 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878518 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878604 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878822 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.878916 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879126 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879222 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879429 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879516 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879737 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.879844 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880071 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880158 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880377 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880462 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880684 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880771 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.880990 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881085 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881291 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881379 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881596 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881693 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.881900 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882016 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882241 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882394 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882555 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882644 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882858 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.882953 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883158 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883259 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883460 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883547 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883758 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.883863 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884089 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884190 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884391 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884478 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884751 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.884844 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885061 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885156 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885408 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885493 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885708 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.885801 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886012 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886099 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886320 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886408 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886631 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886718 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.886942 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887029 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887243 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887330 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887601 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887737 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.887943 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888033 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888264 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888351 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888572 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888665 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888874 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.888969 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889174 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889274 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889478 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889579 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889800 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.889897 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890092 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890182 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890389 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890688 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.890777 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891004 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891104 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891303 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891403 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891616 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891702 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.891988 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.892078 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.892314 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.892418 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.892628 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.892715 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893033 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893120 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893337 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893424 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893643 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893758 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.893959 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894075 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894275 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894391 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894592 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894717 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.894893 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895044 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895206 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895371 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895510 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895682 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.895837 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896029 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896165 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896346 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896472 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896675 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.896770 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.897003 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.897090 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.897319 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.897418 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898166 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898267 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898457 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898579 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898835 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.898972 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899097 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899298 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899415 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899618 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899745 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.899961 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900188 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900276 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900513 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900599 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900830 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.900925 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901154 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901250 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901457 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901552 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901760 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.901860 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902062 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902148 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902375 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902507 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902675 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902761 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.902981 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903067 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903285 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903386 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903590 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903677 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.903914 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904006 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904215 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904320 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904532 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904619 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904830 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.904916 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905136 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905235 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905448 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905534 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905756 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.905850 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906071 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906158 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906371 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906458 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906686 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906779 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.906991 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907079 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907292 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907381 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907593 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907679 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.907932 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908022 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908237 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908322 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908546 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908684 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908855 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.908943 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909179 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909501 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909598 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909808 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.909903 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910138 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910234 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910463 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910559 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910775 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.910861 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911087 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911174 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911410 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911507 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911714 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.911801 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912040 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912128 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912349 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912438 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912652 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912755 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.912953 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.913043 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.913298 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.913903 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914169 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914260 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914480 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914568 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914787 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.914883 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915095 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915182 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915415 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915503 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915716 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.915804 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916060 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916148 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916366 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916466 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916670 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916758 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.916974 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917070 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917277 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917374 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917708 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.917916 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918009 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918225 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918319 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918544 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918637 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918860 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.918950 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919184 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919280 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919492 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919582 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919834 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.919925 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920153 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920251 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920465 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920552 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920778 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.920865 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921089 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921177 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921401 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921489 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921714 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.921800 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922025 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922114 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922329 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922424 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922640 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922727 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.922951 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923047 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923264 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923351 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923587 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923780 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.923929 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.924133 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.924242 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.924450 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.924763 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.924858 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925081 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925168 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925394 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925481 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925708 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.925804 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926020 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926114 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926330 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926416 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926637 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926733 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.926946 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927033 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927259 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927345 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927574 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927662 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.927913 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.928005 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.928245 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.928331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.928561 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.928650 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.929396 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.929538 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.929750 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.929838 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930154 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930242 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930493 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930578 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930812 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.930908 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931120 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931207 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931433 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931520 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931746 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.931859 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932086 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932173 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932395 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932482 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932706 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.932839 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933017 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933105 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933327 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933414 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933635 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933723 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.933940 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934034 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934248 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934343 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934558 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934646 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934872 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.934967 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935190 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935286 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935504 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935590 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935838 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.935929 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936150 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936259 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936463 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936550 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936798 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.936980 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.937118 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.937295 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.937438 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.937625 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.937948 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938034 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938268 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938355 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938668 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938896 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.938990 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939224 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939312 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939575 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939675 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939846 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.939936 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940160 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940248 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940469 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940556 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940771 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.940857 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941089 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941177 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941400 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941488 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941704 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.941800 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942021 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942116 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942328 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942423 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942637 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942857 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.942946 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.943201 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.943296 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.943516 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.943788 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.943955 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.944168 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.944264 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.944502 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.944603 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.944828 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945008 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945146 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945349 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945444 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945676 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945771 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.945993 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946087 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946325 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946412 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946624 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946723 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.946927 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947015 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947232 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947319 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947536 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947636 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947869 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.947973 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948164 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948251 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948468 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948557 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948780 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.948865 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949079 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949166 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949381 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949469 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949684 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949804 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.949992 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950089 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950294 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950392 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950595 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950690 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950896 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.950991 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951196 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951502 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951597 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951801 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.951996 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952128 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952232 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952430 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952525 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952737 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.952834 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953038 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953135 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953343 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953431 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953648 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953743 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.953964 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954058 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954271 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954358 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954570 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954664 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954881 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.954968 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955186 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955273 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955502 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955598 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955859 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.955951 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956143 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956229 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956454 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956543 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956781 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.956876 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957099 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957307 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957403 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957638 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957749 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.957955 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.958070 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.958284 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.958613 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.958700 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.958917 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959003 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959221 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959317 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959521 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959868 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.959968 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.960741 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.960855 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961057 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961147 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961367 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961463 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961674 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961771 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.961980 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962068 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962287 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962376 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962591 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962687 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962895 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.962984 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963202 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963305 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963505 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963594 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963810 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.963945 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964113 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964201 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964441 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964528 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964750 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.964853 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965061 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965147 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965373 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965469 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965686 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965775 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.965995 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966090 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966309 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966395 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966615 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966701 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.966920 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967015 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967222 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967310 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967527 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967614 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967859 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.967964 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968187 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968284 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968497 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968592 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968797 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.968893 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969152 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969237 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969495 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969599 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969809 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.969907 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970118 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970216 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970421 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970539 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970738 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.970857 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971055 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971179 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971363 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971508 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971678 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.971858 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972011 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972167 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972334 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972492 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972664 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972808 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.972988 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973133 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973307 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973449 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973607 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973781 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.973908 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.974122 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.974449 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.974544 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.974800 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.975086 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.975475 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.975956 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.976289 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.976418 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.976615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.976707 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.976939 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977026 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977269 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977357 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977665 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977884 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.977969 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978185 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978272 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978487 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978574 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978792 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.978891 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979090 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979175 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979391 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979489 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979689 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.979791 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980015 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980114 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980313 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980408 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980612 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980711 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.980916 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981012 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981215 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981300 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981515 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981609 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981814 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.981899 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982113 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982206 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982412 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982500 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982720 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.982805 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983078 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983170 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983348 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983499 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983655 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983787 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.983985 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984076 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984301 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984389 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984605 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984695 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.984919 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985005 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985232 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985327 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985538 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985626 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985844 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.985944 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986170 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986258 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986479 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986566 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986785 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.986882 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987092 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987179 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987396 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987482 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987698 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.987802 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988026 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988114 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988349 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988438 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988669 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988765 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.988970 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989057 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989282 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989368 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989593 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989681 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.989911 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.990038 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.990231 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.990360 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.990525 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.990613 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.991101 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.991194 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.991946 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992061 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992253 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992341 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992565 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992651 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992872 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.992969 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993178 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993265 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993499 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993593 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993797 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.993894 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994112 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994213 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994429 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994517 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994731 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.994825 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995049 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995144 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995366 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995453 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995694 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.995781 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996031 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996127 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996360 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996447 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996681 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996769 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.996996 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997084 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997304 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997392 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997604 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997705 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.997845 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103292) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:57:46.997984 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.998303 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.998622 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.998932 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 11:57:46.999180 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 11:57:47.056376 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO dbcounter [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Registered counter for database nova_api May 30 11:57:47.057789 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO dbcounter [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Registered counter for database nova_api May 30 11:57:47.078159 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.079908 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_db.sqlalchemy.engines [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.085594 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writer thread running {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.087366 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writer thread running {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.142229 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.context [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),975509b8-a7ed-4f66-b307-9619b582ed41(cell1) {{(pid=103292) load_cells /opt/stack/nova/nova/context.py:464}} May 30 11:57:47.143437 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.context [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),975509b8-a7ed-4f66-b307-9619b582ed41(cell1) {{(pid=103293) load_cells /opt/stack/nova/nova/context.py:464}} May 30 11:57:47.146314 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_concurrency.lockutils [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:57:47.147574 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:57:47.148422 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_concurrency.lockutils [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:57:47.148870 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_concurrency.lockutils [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:57:47.149422 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:57:47.150228 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 11:57:47.150778 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_concurrency.lockutils [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103292) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:57:47.152205 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 11:57:47.152789 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO dbcounter [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Registered counter for database nova_cell0 May 30 11:57:47.154201 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO dbcounter [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Registered counter for database nova_cell0 May 30 11:57:47.156741 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO dbcounter [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Registered counter for database nova_cell1 May 30 11:57:47.158194 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO dbcounter [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Registered counter for database nova_cell1 May 30 11:57:47.164537 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.167850 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_db.sqlalchemy.engines [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.167993 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.171184 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writer thread running {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.171843 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_db.sqlalchemy.engines [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.173352 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writer thread running {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.174594 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writer thread running {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.314522 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writer thread running {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.323592 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO dbcounter [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Registered counter for database nova_cell0 May 30 11:57:47.325236 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO dbcounter [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Registered counter for database nova_cell0 May 30 11:57:47.332490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_db.sqlalchemy.engines [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.337117 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG oslo_db.sqlalchemy.engines [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103292) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 11:57:47.337387 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writer thread running {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.341718 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writer thread running {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 11:57:47.797339 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: WARNING keystonemiddleware.auth_token [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:57:47.805386 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: WARNING keystonemiddleware.auth_token [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:57:47.807956 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: WARNING keystonemiddleware.auth_token [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:57:47.815297 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: WARNING keystonemiddleware.auth_token [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:57:48.026436 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: WARNING keystonemiddleware.auth_token [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:57:48.032325 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: WARNING keystonemiddleware.auth_token [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:57:48.037413 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629b3f1c9c0 pid: 103293 (default app) May 30 11:57:48.039377 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: WARNING keystonemiddleware.auth_token [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 11:57:48.040264 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:57:48.041429 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001974 May 30 11:57:48.041841 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 788 bytes} [Mon May 30 11:57:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:57:48.045364 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: WARNING keystonemiddleware.auth_token [None req-74fe57f3-5f4b-493c-93b9-b54c157d9138 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 11:57:48.050472 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5629b3f1c9c0 pid: 103292 (default app) May 30 11:59:06.914051 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:06.915051 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 30 11:59:06.915458 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:06.928761 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_api:SELECT=3 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:06.929868 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_cell1:SELECT=3 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:06.930815 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_cell0:SELECT=3 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:06.931696 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:07.368217 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-2a11f6ca-5591-448c-bfe9-974f86cfbfdc admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:07.399324 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-2a11f6ca-5591-448c-bfe9-974f86cfbfdc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476610 May 30 11:59:07.400080 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1291 bytes} [Mon May 30 11:59:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:09.731912 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:09.732911 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-73408da0-fc7f-4fa5-a30a-ed83bf9f4379 None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 30 11:59:09.733374 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:09.796613 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-7eb14afa-7cec-4b2a-9996-57cd4517f3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "swap": 0}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:09.814815 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:59:09.814815 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: warnings.warn(msg) May 30 11:59:09.843908 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-7eb14afa-7cec-4b2a-9996-57cd4517f3ca admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104254 May 30 11:59:09.844784 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:09 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:09.858017 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_api:SELECT=3 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:09.859382 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_cell0:SELECT=3 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:09.860133 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_cell1:SELECT=3 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:09.860836 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 11:59:10.065460 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-d245ece2-7ddb-43cf-9d04-2cbeb901bd53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:10.068544 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:59:10.068544 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 11:59:10.137744 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-d245ece2-7ddb-43cf-9d04-2cbeb901bd53 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284801 May 30 11:59:10.138516 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1335 bytes} [Mon May 30 11:59:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:12.455327 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-7eb14afa-7cec-4b2a-9996-57cd4517f3ca admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:12.456499 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-7eb14afa-7cec-4b2a-9996-57cd4517f3ca admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 May 30 11:59:12.457140 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:12.574474 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-84a70427-cf79-4734-8a6b-cca306c66d7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "ram": 512, "disk": 5}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:12.592203 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:59:12.592203 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 11:59:12.610295 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-84a70427-cf79-4734-8a6b-cca306c66d7d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145828 May 30 11:59:12.610881 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:59:12.623413 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-1153df76-dac7-4ed2-b352-88d73344be1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:12.624945 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 11:59:12.624945 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: warnings.warn(msg) May 30 11:59:12.656997 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-1153df76-dac7-4ed2-b352-88d73344be1b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037170 May 30 11:59:12.657569 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1335 bytes} [Mon May 30 11:59:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:14.982765 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-84a70427-cf79-4734-8a6b-cca306c66d7d admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:14.983875 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-84a70427-cf79-4734-8a6b-cca306c66d7d admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 May 30 11:59:14.984469 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:15.047994 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-b6e0400c-d19b-48f3-bed9-deb01ac84cdc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "disk": 10, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:15.068154 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-b6e0400c-d19b-48f3-bed9-deb01ac84cdc admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077255 May 30 11:59:15.068707 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:59:15.080785 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-d3d16dd6-741d-4528-b51f-a3dd88eeae1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:15.108680 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-d3d16dd6-741d-4528-b51f-a3dd88eeae1c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031081 May 30 11:59:15.110133 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1335 bytes} [Mon May 30 11:59:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:17.438623 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-b6e0400c-d19b-48f3-bed9-deb01ac84cdc admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:17.439667 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-b6e0400c-d19b-48f3-bed9-deb01ac84cdc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 30 11:59:17.440111 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 11:59:17.499381 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-f0c5514a-9d12-4d8f-82a6-e44feb6fbcce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "disk": 10, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:17.516953 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-f0c5514a-9d12-4d8f-82a6-e44feb6fbcce admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070796 May 30 11:59:17.517508 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:17.529845 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-b334312a-cb63-4b43-8877-91e660b0b7c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:17.556508 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-b334312a-cb63-4b43-8877-91e660b0b7c2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030254 May 30 11:59:17.557116 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1335 bytes} [Mon May 30 11:59:17 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:19.921984 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-f0c5514a-9d12-4d8f-82a6-e44feb6fbcce admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:19.923005 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-f0c5514a-9d12-4d8f-82a6-e44feb6fbcce admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 30 11:59:19.923411 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:19.983721 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4", "name": "ds4G"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:20.004487 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074404 May 30 11:59:20.006269 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:20.018257 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-870e26c4-8fae-49a6-abad-218a632a3564 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:20.044759 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-870e26c4-8fae-49a6-abad-218a632a3564 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030110 May 30 11:59:20.049819 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1335 bytes} [Mon May 30 11:59:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 11:59:22.347079 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:22.349236 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002235 May 30 11:59:22.349977 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:22.419531 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-506f4a7c-784e-4d35-9615-bf29590ce115 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:22.445882 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-506f4a7c-784e-4d35-9615-bf29590ce115 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.089225 May 30 11:59:22.446433 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1291 bytes} [Mon May 30 11:59:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 11:59:24.761657 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:24.763242 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-0c357321-3660-431d-b14e-69eb4a787970 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002300 May 30 11:59:24.764580 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:24.824219 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-35a565fa-5a45-4e7b-8705-65e80af67948 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "id": "1", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:24.842468 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-35a565fa-5a45-4e7b-8705-65e80af67948 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071422 May 30 11:59:24.843177 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:59:24.856124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-2522f0c4-931c-45e2-bc01-71f13b2ae287 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:24.882988 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-2522f0c4-931c-45e2-bc01-71f13b2ae287 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030321 May 30 11:59:24.884480 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1332 bytes} [Mon May 30 11:59:24 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:27.292125 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-35a565fa-5a45-4e7b-8705-65e80af67948 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:27.293290 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-35a565fa-5a45-4e7b-8705-65e80af67948 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001724 May 30 11:59:27.293719 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:27.358063 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-cfa9b8a1-bef3-4cb3-b26f-650d731ab002 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:27.376779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-cfa9b8a1-bef3-4cb3-b26f-650d731ab002 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077171 May 30 11:59:27.377374 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:27.389640 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-eb0ca702-d8ea-4621-a114-53bdba689a20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:27.413397 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-eb0ca702-d8ea-4621-a114-53bdba689a20 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027432 May 30 11:59:27.413982 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1332 bytes} [Mon May 30 11:59:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:29.782728 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-cfa9b8a1-bef3-4cb3-b26f-650d731ab002 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:29.783756 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-cfa9b8a1-bef3-4cb3-b26f-650d731ab002 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 30 11:59:29.784231 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:29.843304 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-60058fb8-29c2-4e2d-9a4f-fadf08a23206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "ram": 4096, "vcpus": 2}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:29.862087 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-60058fb8-29c2-4e2d-9a4f-fadf08a23206 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071693 May 30 11:59:29.862642 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:29.874692 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-81ae7339-0745-4638-be6e-bb321e43ea44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:29.899149 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-81ae7339-0745-4638-be6e-bb321e43ea44 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028214 May 30 11:59:29.899721 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1332 bytes} [Mon May 30 11:59:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:32.211673 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-60058fb8-29c2-4e2d-9a4f-fadf08a23206 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:32.212738 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-60058fb8-29c2-4e2d-9a4f-fadf08a23206 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 30 11:59:32.213150 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:32.277553 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-44879f73-c78d-4d03-bc51-8d508796c6d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:32.295990 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-44879f73-c78d-4d03-bc51-8d508796c6d7 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076926 May 30 11:59:32.296835 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 11:59:32.311602 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-9c72eddb-2ccc-4324-990c-e4761ea0156c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:32.335289 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-9c72eddb-2ccc-4324-990c-e4761ea0156c admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027615 May 30 11:59:32.336068 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1332 bytes} [Mon May 30 11:59:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 11:59:34.713541 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-44879f73-c78d-4d03-bc51-8d508796c6d7 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 11:59:34.714571 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-44879f73-c78d-4d03-bc51-8d508796c6d7 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 30 11:59:34.715259 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 11:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 11:59:34.796485 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:34.815895 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.094528 May 30 11:59:34.817567 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1282 bytes} [Mon May 30 11:59:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 11:59:34.830982 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6d83ecd2-3a5a-414d-9eb5-df8571167754 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 11:59:34.859669 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6d83ecd2-3a5a-414d-9eb5-df8571167754 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032140 May 30 11:59:34.860491 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1332 bytes} [Mon May 30 11:59:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:00:00.069968 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:00.071093 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 30 12:00:00.071492 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 12:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:00.082022 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:00.131981 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-8d276591-0940-4f5b-96fc-8c2d9c7cefbe admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:00.149179 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-8d276591-0940-4f5b-96fc-8c2d9c7cefbe admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071716 May 30 12:00:00.149724 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1291 bytes} [Mon May 30 12:00:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:01.157944 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:01.158945 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-b7e271ab-020c-412c-89cc-babd42a3e462 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 30 12:00:01.159346 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:01.405699 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-414089ea-650a-4bec-b62a-523b820dd421 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:01.412521 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.wsgi [None req-414089ea-650a-4bec-b62a-523b820dd421 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-414089ea-650a-4bec-b62a-523b820dd421 admin admin] Request method failure captured: May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept: application/json May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept-Encoding: gzip, deflate May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Connection: keep-alive May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Content-Length: 0 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Host: 10.222.0.41 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-Api-Version: compute 2.90 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-System-Scope: None May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: User-Agent: python-novaclient May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Auth-Token: gAAAAABilLHBPHQgMtKllUAgPMgc4BZyeCYkgVTOV_F6TYDYjBWEdNYGpu1JDPvh8g4VUfeiOscFwq49_mR8NRvGHalXMh1G8v13cfF2MQZiSKJ9MwLRBLIpx6RxhoRor3Ynn-uJaXLnsejIL6aAXkm4znANpDwXiBAuY5Ydwn-9ndKA4YgxuK4 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Id: None May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Name: None May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Identity-Status: Confirmed May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Is-Admin-Project: True May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Id: default May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Name: Default May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Name: admin May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Role: member,reader,admin May 30 12:00:01.415725 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Roles: member,reader,admin May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant: admin May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Name: admin May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User: admin May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Id: default May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Name: Default May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Name: admin May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: method: > May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: exception: Flavor 42 could not be found. May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: action_args: {'id': '42'} May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:01.417124 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:01.417989 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:01.419109 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-414089ea-650a-4bec-b62a-523b820dd421 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:01.420298 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-414089ea-650a-4bec-b62a-523b820dd421 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063657 May 30 12:00:01.420298 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1190 bytes} [Mon May 30 12:00:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 12:00:01.427275 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-f898fe82-2686-4c60-b2b5-a3adcf5435cd admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:01.430946 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:00:01.451247 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-f898fe82-2686-4c60-b2b5-a3adcf5435cd admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027762 May 30 12:00:01.451811 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:01.461969 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-f48d5628-2026-4f1b-bc7c-bd4ebc69bef5 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:01.487482 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-f48d5628-2026-4f1b-bc7c-bd4ebc69bef5 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029396 May 30 12:00:01.488326 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:01.499551 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-daab0659-213b-40bb-bb94-f57e84794bce admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:01.506055 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.wsgi [None req-daab0659-213b-40bb-bb94-f57e84794bce admin admin] HTTP exception thrown: Flavor 42 could not be found. May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-daab0659-213b-40bb-bb94-f57e84794bce admin admin] Request method failure captured: May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept: application/json May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept-Encoding: gzip, deflate May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Connection: keep-alive May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Content-Length: 0 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Host: 10.222.0.41 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-Api-Version: compute 2.90 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-System-Scope: None May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: User-Agent: python-novaclient May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Auth-Token: gAAAAABilLHBPHQgMtKllUAgPMgc4BZyeCYkgVTOV_F6TYDYjBWEdNYGpu1JDPvh8g4VUfeiOscFwq49_mR8NRvGHalXMh1G8v13cfF2MQZiSKJ9MwLRBLIpx6RxhoRor3Ynn-uJaXLnsejIL6aAXkm4znANpDwXiBAuY5Ydwn-9ndKA4YgxuK4 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Id: None May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Name: None May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Identity-Status: Confirmed May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Is-Admin-Project: True May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Id: default May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Name: Default May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Name: admin May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Role: member,reader,admin May 30 12:00:01.509321 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Roles: member,reader,admin May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant: admin May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Name: admin May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User: admin May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Id: default May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Name: Default May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Name: admin May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: method: > May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: exception: Flavor 42 could not be found. May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: action_args: {'id': '42'} May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:01.510799 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:01.511615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:01.512678 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-daab0659-213b-40bb-bb94-f57e84794bce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:01.513727 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-daab0659-213b-40bb-bb94-f57e84794bce admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015816 May 30 12:00:01.513727 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1190 bytes} [Mon May 30 12:00:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 12:00:02.382390 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-f48d5628-2026-4f1b-bc7c-bd4ebc69bef5 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:02.383401 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-f48d5628-2026-4f1b-bc7c-bd4ebc69bef5 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 30 12:00:02.383806 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:02.579213 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-5c6b9b2d-93ff-4f04-a6e2-60affae6d073 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:02.584824 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.wsgi [None req-5c6b9b2d-93ff-4f04-a6e2-60affae6d073 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-5c6b9b2d-93ff-4f04-a6e2-60affae6d073 admin admin] Request method failure captured: May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept: application/json May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept-Encoding: gzip, deflate May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Connection: keep-alive May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Content-Length: 0 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Host: 10.222.0.41 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-Api-Version: compute 2.90 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-System-Scope: None May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: User-Agent: python-novaclient May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Auth-Token: gAAAAABilLHCizcxbkl6RPH_Iu-fNyQAQzWLAhmpeHAgBYdUpLUOJ43I-9DQkyEjuUSpMLms9avoapg_6YNhSL6UwZhl6juFuprV83CeyiWPPQlurAonm-rCj4DqZEsRyqwYjaQIGt6HtHffONMVWH9vTM6IV9ZpYQI69zie2zr1J3KxHVh7wYA May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Id: None May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Name: None May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Identity-Status: Confirmed May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Is-Admin-Project: True May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Id: default May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Name: Default May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Name: admin May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Role: member,reader,admin May 30 12:00:02.586331 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Roles: member,reader,admin May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant: admin May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Name: admin May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User: admin May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Id: default May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Name: Default May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Name: admin May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: method: > May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: exception: Flavor 84 could not be found. May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: action_args: {'id': '84'} May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:02.587873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:02.589019 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:02.590971 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-5c6b9b2d-93ff-4f04-a6e2-60affae6d073 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:02.592273 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-5c6b9b2d-93ff-4f04-a6e2-60affae6d073 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068182 May 30 12:00:02.592273 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1190 bytes} [Mon May 30 12:00:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 30 12:00:02.597497 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-8a42424b-5140-4ebf-ae16-2de9eea66c93 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:02.611157 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-8a42424b-5140-4ebf-ae16-2de9eea66c93 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017282 May 30 12:00:02.611959 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:02.622105 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-28fc3af3-a663-432d-ac60-745f525f1eb2 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:02.636920 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-28fc3af3-a663-432d-ac60-745f525f1eb2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018410 May 30 12:00:02.637452 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:00:02.646816 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-c31480cc-14bf-4c0e-91a7-58030cde2a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:02.653323 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.wsgi [None req-c31480cc-14bf-4c0e-91a7-58030cde2a06 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-c31480cc-14bf-4c0e-91a7-58030cde2a06 admin admin] Request method failure captured: May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept: application/json May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept-Encoding: gzip, deflate May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Connection: keep-alive May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Content-Length: 0 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Host: 10.222.0.41 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-Api-Version: compute 2.90 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-System-Scope: None May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: User-Agent: python-novaclient May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Auth-Token: gAAAAABilLHCizcxbkl6RPH_Iu-fNyQAQzWLAhmpeHAgBYdUpLUOJ43I-9DQkyEjuUSpMLms9avoapg_6YNhSL6UwZhl6juFuprV83CeyiWPPQlurAonm-rCj4DqZEsRyqwYjaQIGt6HtHffONMVWH9vTM6IV9ZpYQI69zie2zr1J3KxHVh7wYA May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Id: None May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Name: None May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Identity-Status: Confirmed May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Is-Admin-Project: True May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Id: default May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Name: Default May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Name: admin May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Role: member,reader,admin May 30 12:00:02.654839 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Roles: member,reader,admin May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant: admin May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Name: admin May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User: admin May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Id: default May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Name: Default May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Name: admin May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: method: > May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: exception: Flavor 84 could not be found. May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: action_args: {'id': '84'} May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:02.656581 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:02.657495 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:02.658752 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-c31480cc-14bf-4c0e-91a7-58030cde2a06 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:02.659965 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-c31480cc-14bf-4c0e-91a7-58030cde2a06 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013138 May 30 12:00:02.659965 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1190 bytes} [Mon May 30 12:00:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 30 12:00:03.649634 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-28fc3af3-a663-432d-ac60-745f525f1eb2 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:03.650646 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-28fc3af3-a663-432d-ac60-745f525f1eb2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 May 30 12:00:03.651079 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:03.866455 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-bfe02266-2229-42e2-8d0d-6a113df16e94 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:03.872262 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.wsgi [None req-bfe02266-2229-42e2-8d0d-6a113df16e94 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-bfe02266-2229-42e2-8d0d-6a113df16e94 admin admin] Request method failure captured: May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept: application/json May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Accept-Encoding: gzip, deflate May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Connection: keep-alive May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Content-Length: 0 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Host: 10.222.0.41 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-Api-Version: compute 2.90 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Openstack-System-Scope: None May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: User-Agent: python-novaclient May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Auth-Token: gAAAAABilLHDHbGVspFi03oAMUgbsUvdTAUwZvesrVBq1Yw6X5XZ3qInivyRtKhyqkrhX4vAmqHLi4U9EAHDwQHwQD_N6U8nh3hxvMlz7TTQHvQvUuNJyaTT94y5kY4QMUD0gnuJ-pffv6RAgdEGdrx9Aslhm8Y3MzegvAihjkKUI5Vb-2BrRPk May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Id: None May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Domain-Name: None May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Identity-Status: Confirmed May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Is-Admin-Project: True May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Id: default May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Domain-Name: Default May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Project-Name: admin May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Role: member,reader,admin May 30 12:00:03.873779 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Roles: member,reader,admin May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant: admin May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-Tenant-Name: admin May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User: admin May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Id: default May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Domain-Name: Default May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: X-User-Name: admin May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: method: > May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: exception: Flavor 451 could not be found. May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: action_args: {'id': '451'} May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:03.875115 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:03.875909 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: ERROR nova.api.openstack.wsgi May 30 12:00:03.877023 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-bfe02266-2229-42e2-8d0d-6a113df16e94 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103292) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:03.878261 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-bfe02266-2229-42e2-8d0d-6a113df16e94 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061036 May 30 12:00:03.878261 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:00:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 12:00:03.887182 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-5e230cfb-562f-4700-910e-f6fc4c418b9b admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:03.901835 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-5e230cfb-562f-4700-910e-f6fc4c418b9b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019676 May 30 12:00:03.902406 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:03.912106 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:03.925422 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016944 May 30 12:00:03.926472 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1210 bytes} [Mon May 30 12:00:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:00:03.935891 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-da5618a4-6310-4602-abb0-f44cf1776350 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:03.941163 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.wsgi [None req-da5618a4-6310-4602-abb0-f44cf1776350 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-da5618a4-6310-4602-abb0-f44cf1776350 admin admin] Request method failure captured: May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept: application/json May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Accept-Encoding: gzip, deflate May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Connection: keep-alive May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Content-Length: 0 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Host: 10.222.0.41 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-Api-Version: compute 2.90 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Openstack-System-Scope: None May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: User-Agent: python-novaclient May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Auth-Token: gAAAAABilLHDHbGVspFi03oAMUgbsUvdTAUwZvesrVBq1Yw6X5XZ3qInivyRtKhyqkrhX4vAmqHLi4U9EAHDwQHwQD_N6U8nh3hxvMlz7TTQHvQvUuNJyaTT94y5kY4QMUD0gnuJ-pffv6RAgdEGdrx9Aslhm8Y3MzegvAihjkKUI5Vb-2BrRPk May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Id: None May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Domain-Name: None May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Identity-Status: Confirmed May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Is-Admin-Project: True May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Openstack-Nova-Api-Version: 2.90 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Id: default May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Domain-Name: Default May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Project-Name: admin May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Role: member,reader,admin May 30 12:00:03.943299 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Roles: member,reader,admin May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_93674931dbb347aea1d901cb89aa3b24", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/93674931dbb347aea1d901cb89aa3b24"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant: admin May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Id: 93674931dbb347aea1d901cb89aa3b24 May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-Tenant-Name: admin May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User: admin May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Id: default May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Domain-Name: Default May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Id: 6a1c89e7dfbe47f0b169c936907738b0 May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: X-User-Name: admin May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: method: > May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: exception: Flavor 451 could not be found. May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: action_args: {'id': '451'} May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:00:03.944873 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:03.945815 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: ERROR nova.api.openstack.wsgi May 30 12:00:03.947108 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-da5618a4-6310-4602-abb0-f44cf1776350 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103293) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:00:03.948568 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-da5618a4-6310-4602-abb0-f44cf1776350 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012428 May 30 12:00:03.948568 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:00:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 30 12:00:04.828827 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:04.829842 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 May 30 12:00:04.830247 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:05.030595 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-3c90feb3-5e0b-47c7-8388-2b18f59457ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:00:05.049501 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-3c90feb3-5e0b-47c7-8388-2b18f59457ee admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.073056 May 30 12:00:05.050054 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1235 bytes} [Mon May 30 12:00:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:00:05.935794 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:05.936833 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 30 12:00:05.937231 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:06.125944 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-f5be7639-88d1-4f3b-8981-f1f00958c09a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:00:06.142845 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-f5be7639-88d1-4f3b-8981-f1f00958c09a admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068833 May 30 12:00:06.143402 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1235 bytes} [Mon May 30 12:00:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:00:07.013705 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:07.014852 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 May 30 12:00:07.015409 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:07.216315 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-e57a1228-a495-420d-9bad-168697cac904 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:00:07.233216 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-e57a1228-a495-420d-9bad-168697cac904 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070035 May 30 12:00:07.233764 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1235 bytes} [Mon May 30 12:00:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:00:08.107687 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:08.108739 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 30 12:00:08.109139 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:08.298614 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-8016a3c8-0988-44d9-985d-de7359d28265 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:00:08.315443 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-8016a3c8-0988-44d9-985d-de7359d28265 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067954 May 30 12:00:08.316061 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1235 bytes} [Mon May 30 12:00:08 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:00:09.199119 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:09.200288 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 May 30 12:00:09.200773 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:00:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:00:09.418813 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-d61b746e-db9d-48d2-8939-2037785e96a1 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:00:09.438282 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-d61b746e-db9d-48d2-8939-2037785e96a1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078838 May 30 12:00:09.438825 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1202 bytes} [Mon May 30 12:00:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:01:11.713553 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.714596 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-6ba607e7-639e-4c68-b679-cdf5d5d91a06 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 30 12:01:11.714996 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 930 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:01:11.722276 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:01:11.775548 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-dfa0a284-863c-41f0-ab6f-6b41c78c3d97 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.794593 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-dfa0a284-863c-41f0-ab6f-6b41c78c3d97 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073679 May 30 12:01:11.795147 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1291 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:01:11.816377 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG dbcounter [-] [103292] Writing DB stats nova_api:SELECT=14 {{(pid=103292) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:01:11.820922 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-b637b05a-370d-4d1c-9c50-1e136400a851 admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.828661 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-b637b05a-370d-4d1c-9c50-1e136400a851 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013749 May 30 12:01:11.829187 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1282 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:01:11.841349 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-cc90ee54-4920-455f-8b22-ef26dd89de27 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.849516 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-cc90ee54-4920-455f-8b22-ef26dd89de27 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012027 May 30 12:01:11.850067 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1285 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:01:11.861789 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.870559 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012378 May 30 12:01:11.871270 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1285 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:01:11.883069 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-fa667e7d-93ab-46ff-a932-5598be2fbf75 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:01:11.890615 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-fa667e7d-93ab-46ff-a932-5598be2fbf75 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011745 May 30 12:01:11.891136 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1282 bytes} [Mon May 30 12:01:11 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:04:32.318763 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:32.319791 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 30 12:04:32.320220 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 34/69] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:04:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:32.475695 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_api:SELECT=6 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:32.590433 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:32.591604 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:04:32.591604 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 12:04:32.592992 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:32.593477 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:32.594213 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:32.594649 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:32.628777 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-d75325d7-6a46-42d8-b624-65c0faa89747 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154545 May 30 12:04:32.629356 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 36/70] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:04:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:04:33.513128 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:33.514144 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 May 30 12:04:33.514547 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 35/71] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:04:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:33.704091 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:33.705306 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:04:33.705306 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 12:04:33.706490 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:33.706936 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:33.707734 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:33.708205 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:33.728248 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-2d97920b-cffd-443a-a42a-5236b7278b3b admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076079 May 30 12:04:33.728741 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 37/72] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:04:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:04:45.067066 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.068145 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 May 30 12:04:45.068555 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 36/73] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:45.213910 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_cell0:SELECT=4 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.214629 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_cell1:SELECT=4 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.215323 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG dbcounter [-] [103293] Writing DB stats nova_api:SELECT=8 {{(pid=103293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:04:45.264466 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:45.265707 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:04:45.265707 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 12:04:45.267067 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.267637 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.268494 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:45.268952 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:45.294181 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-7c3d936d-360c-4780-b6ef-aaa42e97cf81 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084627 May 30 12:04:45.294660 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 38/74] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:04:45 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:04:46.200360 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: DEBUG nova.api.openstack.wsgi [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] Calling method '>' {{(pid=103292) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:46.201364 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: INFO nova.api.openstack.requestlog [None req-a222f7ca-75cd-48f3-a1b9-6799304592cb admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 30 12:04:46.201773 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: [pid: 103292|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1074 bytes} [Mon May 30 12:04:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:04:46.394271 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG nova.api.openstack.wsgi [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] Calling method '>' {{(pid=103293) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:04:46.395630 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 30 12:04:46.395630 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: warnings.warn(msg) May 30 12:04:46.396947 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.397393 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.398207 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:04:46.398637 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: DEBUG oslo_concurrency.lockutils [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103293) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:04:46.420949 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: INFO nova.api.openstack.requestlog [None req-1f67e27d-8d58-4738-8b06-372a7193e51f admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080261 May 30 12:04:46.421685 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: [pid: 103293|app: 0|req: 39/76] 10.222.0.41 () {60 vars in 1193 bytes} [Mon May 30 12:04:46 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:05:43.331431 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: Mon May 30 12:05:43 2022 - graceful shutdown triggered... May 30 12:05:43.331963 dv-cinder-839793-13-iscsi devstack@n-api.service[103292]: Gracefully killing worker 1 (pid: 103292)... May 30 12:05:43.331567 dv-cinder-839793-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 30 12:05:43.332827 dv-cinder-839793-13-iscsi devstack@n-api.service[103293]: Gracefully killing worker 2 (pid: 103293)... May 30 12:05:44.332566 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: worker 1 buried after 1 seconds May 30 12:05:44.332945 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: worker 2 buried after 1 seconds May 30 12:05:44.332945 dv-cinder-839793-13-iscsi devstack@n-api.service[103291]: goodbye to uWSGI. May 30 12:05:44.334694 dv-cinder-839793-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 30 12:05:44.335315 dv-cinder-839793-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 30 12:05:44.338017 dv-cinder-839793-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 30 12:05:44.355271 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon May 30 12:05:44 2022] *** May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: nodename: dv-cinder-839793-13-iscsi May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: machine: x86_64 May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: clock source: unix May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: pcre jit disabled May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: detected number of CPU cores: 4 May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: current working directory: / May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: detected binary path: /usr/bin/uwsgi-core May 30 12:05:44.377256 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: your processes number limit is 47680 May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: your memory page size is 4096 bytes May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: detected max file descriptor number: 2048 May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: lock engine: pthread robust mutexes May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: thunder lock: enabled May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 30 12:05:44.378106 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 30 12:05:44.424819 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: Python main interpreter initialized at 0x555f295629c0 May 30 12:05:44.424819 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: python threads support enabled May 30 12:05:44.424819 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: your server socket listen backlog is limited to 100 connections May 30 12:05:44.424819 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: your mercy for graceful operations on workers is 90 seconds May 30 12:05:44.425358 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: mapped 403077 bytes (393 KB) for 2 cores May 30 12:05:44.425358 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: *** Operational MODE: preforking *** May 30 12:05:44.425506 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: *** uWSGI is running in multiple interpreter mode *** May 30 12:05:44.425506 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: spawned uWSGI master process (pid: 117685) May 30 12:05:44.425718 dv-cinder-839793-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 30 12:05:44.426864 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: spawned uWSGI worker 1 (pid: 117705, cores: 1) May 30 12:05:44.426864 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: spawned uWSGI worker 2 (pid: 117706, cores: 1) May 30 12:05:44.426864 dv-cinder-839793-13-iscsi devstack@n-api.service[117685]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 30 12:05:45.665587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 12:05:45.690484 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 30 12:05:46.500288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:05:46.500288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: from cryptography.utils import int_from_bytes May 30 12:05:46.500753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:05:46.500753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: from cryptography.utils import int_from_bytes May 30 12:05:46.546700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:05:46.546700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: from cryptography.utils import int_from_bytes May 30 12:05:46.547039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 30 12:05:46.547039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: from cryptography.utils import int_from_bytes May 30 12:05:48.916505 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 12:05:48.917060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 12:05:48.917364 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 12:05:48.917643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 12:05:48.917902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 12:05:48.918292 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.918624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.918948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.919269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.919601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.919939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.920259 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.920578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.920905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.921166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.921481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.921806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-13-iscsi {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.922127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.922435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.922749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.923065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.923370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.923690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.924021 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.924518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.925931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.925931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.925931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.926305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.927011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.927011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.927157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.927699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.928067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.928376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.928889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-13-iscsi {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.929112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.929431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.929734 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.930179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.930467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.930803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.931101 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.935468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.936469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.936469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.936469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.936469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.937057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.937057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.937334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.937630 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.937938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.938247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.938558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.938861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.939168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.939476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.939785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.940128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.940582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.940911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.941224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.941544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.941955 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.942201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.942516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.942857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.942857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.944015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.944337 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.944660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.944969 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.945279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.945599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.945916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.946257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.946559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.946810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.947111 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.947415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.947735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.948067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.948373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.948683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.948983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.949288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.949593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.949899 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.950203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.950508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.950813 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.951120 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.951423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.951727 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.952070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.952394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.952704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.953011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.953318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.953626 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.953946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.954254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.954561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.954883 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.955190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.955502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.955909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.956149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.956455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.956772 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.957073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.957380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.957696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.958006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.958313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.959159 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.959525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.959839 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.960154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.960460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.960769 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.961069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.961390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.961711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.962019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.962325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.962629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.962949 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:48.963288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.963621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.963992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.964308 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.964644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.964977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.965298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.965617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.965934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.966260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.966573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.966887 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.967199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.967518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.967858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.968185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.968500 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.968818 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.969138 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.969453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.969771 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.970095 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.970417 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.971301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.971301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.971565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.971702 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.972537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.972953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.973275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.973594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.973913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.974274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.974617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.974936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.975652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.975652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.975906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.976212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.976528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.976844 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.977185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.977503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.977822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.978137 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.978462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.978777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.979091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.979403 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.979710 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.980045 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.980350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.980662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.980969 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.981291 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.981620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.981929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.982342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.982667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.982982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.983294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.983605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.983933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.984249 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.984561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.984866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.985191 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.985512 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.986074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.986400 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.986707 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.987014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.987330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.987644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.987982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.988300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.988616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.988938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.989255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.989571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.990434 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.990768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.991072 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.991397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.991723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.992065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.992375 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.992686 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.992988 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.993294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.993598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.993907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.994210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.994516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.994821 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.995123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.995425 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.995747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.996086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.996393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.996696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.997002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.997343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.997649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.997990 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.998326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.998652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.998974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.999290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.999623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:48.999939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.000257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.000569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.000883 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.001206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.001519 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.001844 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.002155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.002480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.002791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.003110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.003420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.003737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.004102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.004436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.004753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.005074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.005411 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.005760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.006246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.006564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.006877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.007192 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.007511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.007846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.008165 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.008478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.008801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.009112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.009431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.009735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.010049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.010377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.010708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.011019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.011332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.011652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.011996 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.012309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.012625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.012933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.013238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.013567 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.013865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.014176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.014491 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.014797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.015112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.015422 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.015726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.016059 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.016372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.016696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.017010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.017332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.017657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.017961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.018266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.018588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.018904 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.019209 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.019515 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.019903 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.020184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.020495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.020800 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.021667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.022169 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.022482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.022802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.023113 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.023466 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.023744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.024096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.024423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.024721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.025039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.025352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.025664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.025990 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.026302 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.026620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.026932 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.027237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.027549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.027890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.028473 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.028811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.029132 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.029452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.029780 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.030102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.030436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.030767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.031110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.031419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.031733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.032065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.032368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.032694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.032989 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.033299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.033601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.033909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.034213 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.034517 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.034822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.035128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.035443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.035746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.036085 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.036389 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.036761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.037073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.037379 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.037685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.037989 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.038331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.038637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.038973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.039307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.039649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.039978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.040283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.040608 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.040912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.041216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.041519 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.041830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.042141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.042444 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.042757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.043069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.043377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.043683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.044017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.044327 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.044630 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.044944 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.045252 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.045553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.045851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 30 12:05:49.046266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.046361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 30 12:05:49.046446 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.046446 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.046614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 30 12:05:49.046747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.046975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 30 12:05:49.047074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.047232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 30 12:05:49.047330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.047616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.047706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.047958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.048068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.048262 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.048360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.048565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.048702 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.048873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.048977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.049179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.049286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.049481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.049579 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.049795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.049893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.050104 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.050194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.050373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.050460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.050685 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.050775 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.050993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.051089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-13-iscsi {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.051295 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.051386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.051599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.051697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.051929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.052022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.052759 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.052861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.053084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.053386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.053509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.053698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.053811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.054001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.054092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.054305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.054551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.054656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.054860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.054959 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.055167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.055257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.055475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.055571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.055776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.055892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.056102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.056199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.056405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.056504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.056724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.056822 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.057028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.057116 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.057331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.057420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.057635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.057727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.057936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.058026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-13-iscsi {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.058277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.058376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.058580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.058671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.058910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.058997 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.059225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.059327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.059538 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.059629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.059874 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.059969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.060190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.060289 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.060502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.060592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.060813 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.060904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.061116 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.061214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.061428 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.061527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.061739 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.061830 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.062049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.062140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.062347 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.062454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.062647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.062737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.062949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.063046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.063269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.063376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.063569 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.063691 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.063900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.064055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.064157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.064242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.064443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.064543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.064762 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.064890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.065077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.065174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.065394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.065502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.065636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.065766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.065878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.066003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.066192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.066315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.066509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.066629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.066814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.066943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.067118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.067261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.067422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.067574 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.067726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.067950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.068753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.069061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.069170 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.069368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.069458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.069675 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.069773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.069982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.070072 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.070301 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.070390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.070607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.070695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.070917 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.071008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.071223 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.071313 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.071533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.071624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.071853 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.071960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.072190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.072279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.072501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.072603 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.072837 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.072926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.073151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.073268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.073460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.073560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.073774 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.073885 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.074084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.074231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.074386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.074475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.074686 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.074775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.074988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.075108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.075303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.075422 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.075632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.075730 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.075958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.076067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.076208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.076350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.076505 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.076652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.076805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.076965 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.077118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.077289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.077422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.077594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.077725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.077896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.078028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.078200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.078325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.078521 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.078620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.078825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.078925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.079145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.079243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.079492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.079594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.079794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.079917 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.080113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.080263 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.080416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.080587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.080733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.080901 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.080992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.081212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.081316 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.081537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.081639 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.081860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.081950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.082183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.082283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.082506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.082640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.082795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.082892 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.083104 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.083193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.083407 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.083563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.083773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.084111 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.084363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.084513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.084692 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.084823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.085001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.085150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.085309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.085474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.085628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.085790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.085935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.086117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.086243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.086537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.086627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.086845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.086936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.087151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.087248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.087464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.087554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.087770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.087895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.088101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.088200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.088403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.088501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.088705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.088836 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.089007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.089098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.089311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.089409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.089612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.089708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.089913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.090002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.090209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.090309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.090527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.090617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.090837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.090935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.091144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.091242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.091447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.091544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.091750 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.091883 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.092091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.092183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 30 12:05:49.092416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.092514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.092733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.092831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093674 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.093781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.094931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.095977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.096930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.097887 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.098831 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.099036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.099195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.099453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.099869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.100900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101044 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101347 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.101967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102812 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.102902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.103867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104083 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.104820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.105990 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106391 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106613 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106702 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.106924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107022 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107548 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107879 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.107974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.108891 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109189 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109407 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109505 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.109854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.110023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.110158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.110346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.110560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.110653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111271 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111591 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.111945 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112455 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112759 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.112862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113152 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113685 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113828 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.113997 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.114089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.114320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.114463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.114606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.114704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.115461 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.115804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116461 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116553 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.116870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117095 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.117845 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.118997 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119095 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119628 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119721 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.119961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120367 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.120997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.121918 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122215 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.122823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.123925 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124881 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.124972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125577 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.125889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.126917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127689 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.127789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.128957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.129900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.130151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.130241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.131023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.131356 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.131508 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.131682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.131862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.132970 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133822 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.133912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134477 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.134904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.135905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136058 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136368 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.136987 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137295 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137391 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137704 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.137915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138221 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.138928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.139866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140079 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.140800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141009 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.141943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.142952 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143583 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.143960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.144123 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.144214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.144437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.144528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.144744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.145962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.146160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.146444 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.146823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.146921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147155 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.147945 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148754 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.148857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149672 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149836 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.149983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150073 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.150916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151542 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.151974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152287 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152583 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.152905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153117 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153198 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153423 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.153824 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154445 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.154749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155276 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.155914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156308 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156841 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.156940 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.157256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.157400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.157581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.157729 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.157894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158218 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158542 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.158993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159493 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.159992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160514 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160840 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.160942 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161798 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.161939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.162250 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.162572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.162670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.162885 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.162985 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163630 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.163919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164235 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164529 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.164838 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165204 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165451 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.165956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166864 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.166974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167787 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.167940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168115 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168207 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.168835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169128 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169451 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169676 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.169978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170076 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170281 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170375 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.170978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171302 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.171925 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172453 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.172857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173159 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.173974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174279 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.174967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.175908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176412 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.176850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.177021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.177120 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.177901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178526 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.178937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.179950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180538 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.180847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.181983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182079 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182304 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.182919 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183530 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183628 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.183988 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.184162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 12:05:49.184278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.184464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.184763 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.185063 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.185364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.185663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.185962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.186281 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.186588 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.186889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.187192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.187493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.187849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.188156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.188512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.188814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.189125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.189439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.189748 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.190059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.190367 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.190668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.190979 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.191287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.191601 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.191936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.192239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.192558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.192885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.194202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.194537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.194865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.195194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.195503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.195866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.196152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.196463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.196775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.197085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.197398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.197711 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.198024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.198337 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.198648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.198954 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.199264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.199573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.199900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.200226 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.200537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.200842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.201150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.201454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.201767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.202067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.202494 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.202801 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.203113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.203416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.203723 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.204058 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.204373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.204684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.204985 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.205406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.205720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.206031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.206342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.206643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.206944 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.207251 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.207573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.207900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.208205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.208555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.209360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.209669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.209993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.210414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.210728 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.211035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.211449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.211760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.212100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.212423 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.212742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.213064 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.213368 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.213680 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.214010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.214313 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.214637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.214949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.215262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.215567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.215910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.216235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.216547 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.216870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.217284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.217605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.217916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.218234 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.218557 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.218860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.219164 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.219472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.219776 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.220107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.220430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.220735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.221047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.221357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.221671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.221975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.222278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.222597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.222901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.223222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.223535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.223880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.224225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.224978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.225301 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.225613 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.225921 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.226228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.226535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.226882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.227188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.227508 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.227850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.228184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.228496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.228831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.229158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.229473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.229791 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.230113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.230418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.230719 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.231027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.231331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.231635 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.231975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.232283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.232585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.232886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.233188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.233507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.233809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.234127 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.234434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.234738 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.235041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.235342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.235682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.236264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.236595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.236917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.237239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.237568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.237878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.238201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.238516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.238831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.239148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.239464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.240327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.241100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.241421 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.241732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.242051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.242373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.242693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.243231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.243560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.243896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.244214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.244527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.244842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.244973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO dbcounter [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Registered counter for database nova_api May 30 12:05:49.245156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.245467 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.245777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.246086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.246397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.246725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.247043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.247367 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.247702 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.248044 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.248360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.248675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.248988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.249342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.249655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.249959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.250271 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.250583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.250896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.251209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.251521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.251849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.252172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.252483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.252792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.253106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.253421 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.253744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.254077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.254398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.254715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.255030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.255363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.257002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.257324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.257662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.257993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.258320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.258640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.258959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.259288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.259596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.259929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.260455 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.260714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.260982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.261315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.261637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.261946 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.262267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.262582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.263135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.263488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.263806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.264160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.264490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.264810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.265118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.265441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.265575 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_db.sqlalchemy.engines [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.265749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.266053 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.266370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.266682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.266988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.267294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.267605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.267939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.268247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.268559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.268863 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.269189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.269496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.269802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.270106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.270418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.270722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.271568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.272383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.272701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.272791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writer thread running {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.273028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.273338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.273701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.273963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.274280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.274586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.274897 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.275266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.275590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.276201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.276509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.276833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.277146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.277469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.277783 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.278093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.278441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.278758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.279309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.279645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.279999 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.280337 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.280668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.280978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.281286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.281590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.281914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.282228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.282537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.282846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.283162 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.283472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.283781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.284114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.284424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.284733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.285041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.285348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.285656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.285965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.286277 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.286634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.290041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.290851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.291211 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.291564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.291927 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.292265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.292590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.292918 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.293252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.293597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.293925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.294243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.294680 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.295004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.295334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.295665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.296009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.296345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.296675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.296993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.297321 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.297641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.297976 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.298322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.298657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.298986 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.299296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.299604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.299936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.300252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.300574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.300889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.301195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.301499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.301811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.302120 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.302896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.303210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.303521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.303855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.304167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.304475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.304780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.305087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.305393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.305698 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.306010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.306322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.306628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.306934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.307239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.307542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.307898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.308236 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.308552 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.308876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.309191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.309514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.309824 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.310146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.310468 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.310784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.311093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.311428 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.311741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.312079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.312400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.312713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.313023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.313334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.313668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.313992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.314297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.314623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.314940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.315259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.315577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.315917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.316249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.316562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.316874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.317193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.317506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.317819 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.318573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.318900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.319235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.319566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.319906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.320240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.320569 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.320921 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.321238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.321589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.321918 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.322234 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.322551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.322859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 30 12:05:49.323105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117705) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 30 12:05:49.329086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.context [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),975509b8-a7ed-4f66-b307-9619b582ed41(cell1) {{(pid=117706) load_cells /opt/stack/nova/nova/context.py:464}} May 30 12:05:49.333211 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.336007 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.336817 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.338793 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.340782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO dbcounter [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Registered counter for database nova_cell0 May 30 12:05:49.344793 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO dbcounter [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Registered counter for database nova_cell1 May 30 12:05:49.353123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_db.sqlalchemy.engines [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.354842 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_db.sqlalchemy.engines [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.362016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writer thread running {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.362332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writer thread running {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.388763 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO dbcounter [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Registered counter for database nova_api May 30 12:05:49.409179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_db.sqlalchemy.engines [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.416272 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writer thread running {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.474969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.context [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),975509b8-a7ed-4f66-b307-9619b582ed41(cell1) {{(pid=117705) load_cells /opt/stack/nova/nova/context.py:464}} May 30 12:05:49.479155 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.480803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.481596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:05:49.485045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:05:49.485558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO dbcounter [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Registered counter for database nova_cell0 May 30 12:05:49.490089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO dbcounter [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Registered counter for database nova_cell1 May 30 12:05:49.498732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_db.sqlalchemy.engines [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.500410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_db.sqlalchemy.engines [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.507701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writer thread running {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.508089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writer thread running {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.510753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO dbcounter [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Registered counter for database nova_cell0 May 30 12:05:49.517322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_db.sqlalchemy.engines [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.522472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writer thread running {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.655727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO dbcounter [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Registered counter for database nova_cell0 May 30 12:05:49.663448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_db.sqlalchemy.engines [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117705) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 30 12:05:49.667994 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writer thread running {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 30 12:05:49.958496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: WARNING keystonemiddleware.auth_token [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:05:49.967732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: WARNING keystonemiddleware.auth_token [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:05:50.109197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: WARNING keystonemiddleware.auth_token [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:05:50.120404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: WARNING keystonemiddleware.auth_token [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:05:50.198243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: WARNING keystonemiddleware.auth_token [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:05:50.204427 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: WARNING keystonemiddleware.auth_token [None req-2831c289-c32d-4da7-b122-3e17dbf6fd31 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:05:50.209861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f295629c0 pid: 117706 (default app) May 30 12:05:50.346215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: WARNING keystonemiddleware.auth_token [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 30 12:05:50.353503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: WARNING keystonemiddleware.auth_token [None req-8c99d32d-8145-415f-a73f-c40269ad9e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 30 12:05:50.358893 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555f295629c0 pid: 117705 (default app) May 30 12:06:32.609585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.619986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.621062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.621779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.952560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.953385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.955163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:32.956360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:33.963500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f4caae31-fc4c-4794-88ae-3f3c00c5bbc3 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Action: 'create', calling method: .version_select at 0x7f61a3c01310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-894995299"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:34.210052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b4eaf9c7-37c3-4123-b449-3b6c3c4442f8 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Action: 'create', calling method: .version_select at 0x7f61a3c02310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625628738", "metadata": {"Type": "work"}}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b4eaf9c7-37c3-4123-b449-3b6c3c4442f8 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 121 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:34.237395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-625628738", "metadata": {"Type": "work"}}} May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:34.240145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-625628738', 'metadata': {'Type': 'work'}}}} May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise error May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi '#$%' May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:34.242121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:06:34.247978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:06:34.253100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 30 12:06:34.253100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.256163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b4eaf9c7-37c3-4123-b449-3b6c3c4442f8 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:34.260182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b4eaf9c7-37c3-4123-b449-3b6c3c4442f8 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.659265 May 30 12:06:34.262227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Mon May 30 12:06:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1665 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:06:34.282872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-94c542ec-e7b4-41cb-9b5c-a4c803460915 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Action: 'create', calling method: .version_select at 0x7f61a3aa3670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1203832277", "metadata": {"Type": "work"}}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-94c542ec-e7b4-41cb-9b5c-a4c803460915 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 120 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:34.289062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1203832277", "metadata": {"Type": "work"}}} May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:34.292350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1203832277', 'metadata': {'Type': 'work'}}}} May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise error May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi '0' May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:34.294016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:06:34.297812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:06:34.302040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 30 12:06:34.302040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.303750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-94c542ec-e7b4-41cb-9b5c-a4c803460915 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:34.305621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-94c542ec-e7b4-41cb-9b5c-a4c803460915 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032599 May 30 12:06:34.313747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 2/2] 10.222.0.41 () {60 vars in 1155 bytes} [Mon May 30 12:06:34 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:06:34.327084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e6ee174f-72eb-4a8c-9c65-4499d8c4ff80 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Action: 'create', calling method: .version_select at 0x7f61a3c02670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1729975175", "metadata": {"Type": "work"}}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e6ee174f-72eb-4a8c-9c65-4499d8c4ff80 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 119 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:34.332558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1729975175", "metadata": {"Type": "work"}}} May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:34.335357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1729975175', 'metadata': {'Type': 'work'}}}} May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise error May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi On instance['volume']: May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi '' May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:34.337090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 30 12:06:34.339782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 30 12:06:34.342119 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 30 12:06:34.342119 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.344382 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e6ee174f-72eb-4a8c-9c65-4499d8c4ff80 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:34.346017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e6ee174f-72eb-4a8c-9c65-4499d8c4ff80 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029193 May 30 12:06:34.355203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 3/3] 10.222.0.41 () {60 vars in 1155 bytes} [Mon May 30 12:06:34 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:06:34.368814 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-35f773ec-8cca-4924-8e90-97f7500c1d61 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Calling method '.version_select at 0x7f61a3ab73a0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:34.826013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-35f773ec-8cca-4924-8e90-97f7500c1d61 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] HTTP exception thrown: Volume tempest-invalid-1995940400 could not be found. May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-35f773ec-8cca-4924-8e90-97f7500c1d61 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1995940400 HTTP/1.1 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:34.830080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Volume tempest-invalid-1995940400 could not be found. May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'tempest-invalid-1995940400'} May 30 12:06:34.831652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1995940400 could not be found. (HTTP 404) (Request-ID: req-aabe7df7-7c53-454f-8dc6-7072037f1332) May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.833238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:34.834420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1995940400 could not be found. May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:34.835735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1995940400 could not be found. May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1995940400 could not be found. May 30 12:06:34.836897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:34.839995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-35f773ec-8cca-4924-8e90-97f7500c1d61 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 404 to user: Volume tempest-invalid-1995940400 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:34.841176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-35f773ec-8cca-4924-8e90-97f7500c1d61 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1995940400" status: 404 len: 99 microversion: 2.1 time: 0.484407 May 30 12:06:34.841825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 4/4] 10.222.0.41 () {58 vars in 1217 bytes} [Mon May 30 12:06:34 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1995940400 => generated 99 bytes in 486 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 30 12:06:34.855265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f6f9b781-f7a5-4fdc-995a-8c2542aab97e tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004175 May 30 12:06:34.872861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 5/5] 10.222.0.41 () {58 vars in 1139 bytes} [Mon May 30 12:06:34 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 30 12:06:34.887552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b2dd4a1d-35eb-4572-acd0-9054904f53d1 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013145 May 30 12:06:34.895397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 6/6] 10.222.0.41 () {58 vars in 1136 bytes} [Mon May 30 12:06:34 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 30 12:06:34.911450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-845f0e20-4404-48d8-9694-584431886106 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Calling method '.version_select at 0x7f61a39dd790>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.016879 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-845f0e20-4404-48d8-9694-584431886106 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] HTTP exception thrown: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-845f0e20-4404-48d8-9694-584431886106 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: DELETE /compute/v2.1/os-volumes/425ec029-ba2f-4df8-9ee5-98ee9f033f8f HTTP/1.1 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:35.019377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '425ec029-ba2f-4df8-9ee5-98ee9f033f8f'} May 30 12:06:35.022173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. (HTTP 404) (Request-ID: req-6d870244-0239-42b4-b561-4df5afd532cb) May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.023017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:35.024746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:06:35.027251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-845f0e20-4404-48d8-9694-584431886106 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 404 to user: Volume 425ec029-ba2f-4df8-9ee5-98ee9f033f8f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-845f0e20-4404-48d8-9694-584431886106 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/425ec029-ba2f-4df8-9ee5-98ee9f033f8f" status: 404 len: 109 microversion: 2.1 time: 0.132435 May 30 12:06:35.032659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 7/7] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:06:34 2022] DELETE /compute/v2.1/os-volumes/425ec029-ba2f-4df8-9ee5-98ee9f033f8f => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:06:35.043415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9b87f7d1-8600-4a0c-83f4-be957efb0d6c tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a39dd280>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.158048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f4caae31-fc4c-4794-88ae-3f3c00c5bbc3 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.210614 May 30 12:06:35.159016 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 1/8] 10.222.0.41 () {60 vars in 1154 bytes} [Mon May 30 12:06:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2213 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 30 12:06:35.167406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4c806d7f-0378-43da-9308-5729a2661824 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Calling method '.version_select at 0x7f61a3aca310>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.185870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9b87f7d1-8600-4a0c-83f4-be957efb0d6c tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/1ec701ed-da49-4632-94ad-7575573ec547" status: 200 len: 351 microversion: 2.1 time: 0.154855 May 30 12:06:35.186751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 8/9] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/os-volumes/1ec701ed-da49-4632-94ad-7575573ec547 => generated 351 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:35.197126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a983d8a4-5dc0-4ed8-8083-86a367829dff tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39f4160>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:35.224373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-4c806d7f-0378-43da-9308-5729a2661824 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] HTTP exception thrown: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4c806d7f-0378-43da-9308-5729a2661824 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Request method failure captured: May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/os-volumes/05c67a92-d485-4a02-b15f-4022391ad731 HTTP/1.1 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNIttE1K2T0q5EhoMuMbWhryPHDrdoCDlO9oXCF3De2xFpfpdvY0zs7_WDUl_wx-eOsEkLeuT_k-9jTU7qVBicL66bck08XjvD8xJRLnPlnPAZZhoLFi7ZlefsKjUGRyz7nGF0DgmpdxIHC43dC2QGy30IB_ecvy3NuQS7qQLmobyA May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:06:35.230637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/17d57d33452046db87681a6af1148849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_17d57d33452046db87681a6af1148849", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/17d57d33452046db87681a6af1148849"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 17d57d33452046db87681a6af1148849 May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesNegativeTest-1539775409 May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: bd69530dd4a64d04a17041b55ff69ba0 May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesNegativeTest-1539775409-project May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '05c67a92-d485-4a02-b15f-4022391ad731'} May 30 12:06:35.231940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. (HTTP 404) (Request-ID: req-ccf8d19c-fc43-49ad-8660-259e32666e2c) May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.233156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:35.234803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:06:35.236482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4c806d7f-0378-43da-9308-5729a2661824 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] Returning 404 to user: Volume 05c67a92-d485-4a02-b15f-4022391ad731 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4c806d7f-0378-43da-9308-5729a2661824 tempest-VolumesNegativeTest-1539775409 tempest-VolumesNegativeTest-1539775409-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/05c67a92-d485-4a02-b15f-4022391ad731" status: 404 len: 109 microversion: 2.1 time: 0.072114 May 30 12:06:35.237928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 2/10] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/os-volumes/05c67a92-d485-4a02-b15f-4022391ad731 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:06:35.335768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a983d8a4-5dc0-4ed8-8083-86a367829dff tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 200 len: 344 microversion: 2.1 time: 0.145928 May 30 12:06:35.336674 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 9/11] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:35 2022] GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 344 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:36.354798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-60c00b54-92b3-40f6-894b-1b6606bf9b27 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a3a29af0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:36.494313 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-60c00b54-92b3-40f6-894b-1b6606bf9b27 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 200 len: 345 microversion: 2.1 time: 0.144086 May 30 12:06:36.495126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 3/12] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:36 2022] GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:36.507549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-648228a4-62cf-4076-a148-dc5fcd6e6745 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Action: 'create', calling method: .version_select at 0x7f61a39dd040>, body: {"snapshot": {"volume_id": "bc745524-b836-43b8-af50-0ae651610d5b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1241130100"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:36.919034 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-648228a4-62cf-4076-a148-dc5fcd6e6745 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.416304 May 30 12:06:36.919738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 10/13] 10.222.0.41 () {60 vars in 1161 bytes} [Mon May 30 12:06:36 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:36.932462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b7c3942d-d052-4168-9668-a0e5eb93f4e6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39f4040>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.112676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b7c3942d-d052-4168-9668-a0e5eb93f4e6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 287 microversion: 2.1 time: 0.186646 May 30 12:06:37.118392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 11/14] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:36 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:37.124921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-33fa1ed7-2e97-47c9-ac3b-56ba11806bd5 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39f4e50>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.165981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-897203260", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "networks": [{"uuid": "0ea55a4f-c3d0-477a-9dbe-0beea883b625"}]}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:37.230364 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-33fa1ed7-2e97-47c9-ac3b-56ba11806bd5 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.110436 May 30 12:06:37.236618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 12/15] 10.222.0.41 () {58 vars in 1139 bytes} [Mon May 30 12:06:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:37.241328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7dbd944b-60ee-434b-94dc-d1a66e010439 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a39f4940>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.375742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7dbd944b-60ee-434b-94dc-d1a66e010439 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bb9ecbd4-6c96-4f79-9a72-e877ea41cb92" status: 200 len: 350 microversion: 2.1 time: 0.143091 May 30 12:06:37.383661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 13/16] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:37 2022] GET /compute/v2.1/os-volumes/bb9ecbd4-6c96-4f79-9a72-e877ea41cb92 => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:37.388652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f7363e56-2bc9-48e0-bfbf-61982e029840 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39dda60>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:37.408883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] validate_networks() for [('0ea55a4f-c3d0-477a-9dbe-0beea883b625', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:37.471637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f7363e56-2bc9-48e0-bfbf-61982e029840 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 287 microversion: 2.1 time: 0.086730 May 30 12:06:37.472219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 14/17] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:37 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:38.484087 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9f2c8a51-3d0f-44e0-aa2a-1456a8335a22 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39dd550>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:38.544028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9f2c8a51-3d0f-44e0-aa2a-1456a8335a22 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 287 microversion: 2.1 time: 0.063652 May 30 12:06:38.545182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 15/18] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:38 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:39.560359 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6191c3be-1ce7-42d5-b5ce-ef9d9e6c497e tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39f4280>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:39.656955 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6191c3be-1ce7-42d5-b5ce-ef9d9e6c497e tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 287 microversion: 2.1 time: 0.104049 May 30 12:06:39.657527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 16/19] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:39 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:40.076893 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:40.077423 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:40.077839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:40.078864 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:40.079495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:40.106101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.107668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.109429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:40.110445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:40.241197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Getting quotas for project 2288722145134e6b9b93fb4075f0a291. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:40.270669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Getting quotas for user ec4a4f7736964e5ca31d0ac8f63ffd19 and project 2288722145134e6b9b93fb4075f0a291. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:40.301524 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:40.304742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:40.581292 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a6179552-fcb5-4eda-95e8-9bd7233a4b27 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.772042 May 30 12:06:40.582112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 4/20] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:06:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:06:40.593558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7fea46e7-c9d8-425f-822e-3bb53aed3940 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.595284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7fea46e7-c9d8-425f-822e-3bb53aed3940 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:40.670900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-04d44883-3d86-4f82-b60a-4eae5a10fc69 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a31530d0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.817093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-04d44883-3d86-4f82-b60a-4eae5a10fc69 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 288 microversion: 2.1 time: 0.150211 May 30 12:06:40.822779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 5/21] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:40 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 288 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:40.827850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ba634bcc-95a6-407e-8979-b8b2855257f0 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a313bee0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:40.984424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ba634bcc-95a6-407e-8979-b8b2855257f0 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 202 len: 0 microversion: 2.1 time: 0.160285 May 30 12:06:40.985823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 6/22] 10.222.0.41 () {58 vars in 1253 bytes} [Mon May 30 12:06:40 2022] DELETE /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:06:41.020502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7fea46e7-c9d8-425f-822e-3bb53aed3940 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:41.045390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7fea46e7-c9d8-425f-822e-3bb53aed3940 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1214 microversion: 2.1 time: 0.455219 May 30 12:06:41.046265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 17/23] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:40 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1214 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:41.059738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9a694f9f-2447-4265-af98-f825b85baf81 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a39b51f0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.136462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9a694f9f-2447-4265-af98-f825b85baf81 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 200 len: 287 microversion: 2.1 time: 0.087414 May 30 12:06:41.138496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 18/24] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:41.518288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c771adab-c889-4fe8-9849-2a65176391f6 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a39c7940>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.678412 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c771adab-c889-4fe8-9849-2a65176391f6 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/21b22a74-59fe-4c61-a663-4aee00322f5a" status: 200 len: 350 microversion: 2.1 time: 0.164442 May 30 12:06:41.679660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 19/25] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/os-volumes/21b22a74-59fe-4c61-a663-4aee00322f5a => generated 350 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:41.679894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7b2bc853-1e9d-4cf6-92ad-3a4e29d0f202 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: .version_select at 0x7f61a3153040>, body: {"keypair": {"name": "tempest-keypair-796694744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMNV7I1pNXyuaqdgLjFE+xXiSaiGWF4O6Jaot8jhIckPi3zcX6CADIw9ZQbsb1G8ojJsy9TFO/Huk9wrvHwuVfMtiNVOBgLQwoAizKy8BonHmYkzODlGvbXNs25+nSMOA=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:41.693994 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9672779a-ab93-4b5b-84c0-fd17863bb7de tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a39d5040>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:41.734767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-7b2bc853-1e9d-4cf6-92ad-3a4e29d0f202 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:41.746887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-7b2bc853-1e9d-4cf6-92ad-3a4e29d0f202 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:41.857828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7b2bc853-1e9d-4cf6-92ad-3a4e29d0f202 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.870885 May 30 12:06:41.858437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 7/26] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:06:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:41.912661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9672779a-ab93-4b5b-84c0-fd17863bb7de tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.225285 May 30 12:06:41.913687 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 20/27] 10.222.0.41 () {58 vars in 1133 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:41.928182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fbc66934-52a4-4338-9ad8-6446626a7b60 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a313ba60>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.063314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b54792a8-4a87-4992-8359-e87972855ea9 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.063957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b54792a8-4a87-4992-8359-e87972855ea9 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:42.138197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fbc66934-52a4-4338-9ad8-6446626a7b60 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.215673 May 30 12:06:42.138769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 8/28] 10.222.0.41 () {58 vars in 1148 bytes} [Mon May 30 12:06:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:42.150445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b4d5c161-14e7-4a40-a008-46e3abe257bc tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a28fd280>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.208303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-b4d5c161-14e7-4a40-a008-46e3abe257bc tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] HTTP exception thrown: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b4d5c161-14e7-4a40-a008-46e3abe257bc tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Request method failure captured: May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 HTTP/1.1 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNIVvfyYzrjYJQeAp1Li3rYiuYijIg_0x0cOt6fjZycYxmXRAV_za02FK3nWvi0IWHqcd-I2Av2HdEsMH2QtNCgm3GFlM8g_kD8hpFmQHOtFcEuN2niCFeYcs5jYA4CbGZrzuze7-oL4PSSJh5LJtJJJFgdyHHOq8DnU1-HVsuG0GY May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:06:42.211951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c7e4c2961f55482491f6194da650b479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c7e4c2961f55482491f6194da650b479", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 73143527412b430bb7cfbcd8399ed646 May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875'} May 30 12:06:42.213159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. (HTTP 404) (Request-ID: req-09c7d16d-5a1c-48d2-9c2a-64648df890bc) May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.213860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:42.214823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 30 12:06:42.215925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b4d5c161-14e7-4a40-a008-46e3abe257bc tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Returning 404 to user: Snapshot 8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:42.216962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b4d5c161-14e7-4a40-a008-46e3abe257bc tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875" status: 404 len: 111 microversion: 2.1 time: 0.066863 May 30 12:06:42.219153 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 9/29] 10.222.0.41 () {58 vars in 1250 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/os-snapshots/8ae3a0dd-ebc2-47a4-ba04-c0ad44d81875 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:06:42.232514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2f8f16fc-538e-4654-9897-fad27ec555c0 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a3153d30>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.470418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2f8f16fc-538e-4654-9897-fad27ec555c0 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.249598 May 30 12:06:42.471620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 10/30] 10.222.0.41 () {58 vars in 1133 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:42.484159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-92715770-ef06-43ef-a905-099e8cd3470e tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a313bee0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:42.729196 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-92715770-ef06-43ef-a905-099e8cd3470e tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 202 len: 0 microversion: 2.1 time: 0.256148 May 30 12:06:42.734039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 11/31] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:06:42 2022] DELETE /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:06:42.740996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b8d717b4-82a2-4d0e-b00f-d8105211b02e tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a28fd430>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.043477 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b8d717b4-82a2-4d0e-b00f-d8105211b02e tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.308113 May 30 12:06:43.044596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 12/32] 10.222.0.41 () {58 vars in 1166 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:43.056048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5043d750-ea53-42f8-868b-48d439a58bda tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a28f85e0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.126339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-5043d750-ea53-42f8-868b-48d439a58bda tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] HTTP exception thrown: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5043d750-ea53-42f8-868b-48d439a58bda tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Request method failure captured: May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b HTTP/1.1 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNIVvfyYzrjYJQeAp1Li3rYiuYijIg_0x0cOt6fjZycYxmXRAV_za02FK3nWvi0IWHqcd-I2Av2HdEsMH2QtNCgm3GFlM8g_kD8hpFmQHOtFcEuN2niCFeYcs5jYA4CbGZrzuze7-oL4PSSJh5LJtJJJFgdyHHOq8DnU1-HVsuG0GY May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:06:43.128575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c7e4c2961f55482491f6194da650b479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c7e4c2961f55482491f6194da650b479", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 73143527412b430bb7cfbcd8399ed646 May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'bc745524-b836-43b8-af50-0ae651610d5b'} May 30 12:06:43.130449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. (HTTP 404) (Request-ID: req-a6d60d04-00a1-4b06-af58-d58cb8130053) May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.131137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:43.132159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:06:43.133124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5043d750-ea53-42f8-868b-48d439a58bda tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Returning 404 to user: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:43.134179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5043d750-ea53-42f8-868b-48d439a58bda tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 404 len: 109 microversion: 2.1 time: 0.084312 May 30 12:06:43.139553 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 13/33] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:06:43.146137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-edacfae2-06b1-40ce-ae1a-da16147e7450 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a28fd550>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.244493 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b54792a8-4a87-4992-8359-e87972855ea9 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:43.251323 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b54792a8-4a87-4992-8359-e87972855ea9 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1214 microversion: 2.1 time: 1.191807 May 30 12:06:43.251913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 21/34] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:42 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1214 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:43.274843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fb9a292e-dc46-46f1-8c17-5f1b286d00f1 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a3a2dee0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.334090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-fb9a292e-dc46-46f1-8c17-5f1b286d00f1 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] HTTP exception thrown: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fb9a292e-dc46-46f1-8c17-5f1b286d00f1 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Request method failure captured: May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: DELETE /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b HTTP/1.1 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIVvfyYzrjYJQeAp1Li3rYiuYijIg_0x0cOt6fjZycYxmXRAV_za02FK3nWvi0IWHqcd-I2Av2HdEsMH2QtNCgm3GFlM8g_kD8hpFmQHOtFcEuN2niCFeYcs5jYA4CbGZrzuze7-oL4PSSJh5LJtJJJFgdyHHOq8DnU1-HVsuG0GY May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:43.336056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c7e4c2961f55482491f6194da650b479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c7e4c2961f55482491f6194da650b479", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 73143527412b430bb7cfbcd8399ed646 May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'bc745524-b836-43b8-af50-0ae651610d5b'} May 30 12:06:43.337124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. (HTTP 404) (Request-ID: req-d7e0fb86-9efc-43ff-b8b1-21e5480be296) May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.337720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 30 12:06:43.340161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 30 12:06:43.341760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fb9a292e-dc46-46f1-8c17-5f1b286d00f1 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Returning 404 to user: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fb9a292e-dc46-46f1-8c17-5f1b286d00f1 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 404 len: 109 microversion: 2.1 time: 0.084618 May 30 12:06:43.342622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 22/35] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:06:43 2022] DELETE /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:06:43.346254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e8e63789-5305-4631-9220-e4cb07216bb6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Calling method '.version_select at 0x7f61a3a2dca0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.365905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-edacfae2-06b1-40ce-ae1a-da16147e7450 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.225093 May 30 12:06:43.367434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 14/36] 10.222.0.41 () {58 vars in 1169 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:43.380750 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1efae7da-c6e9-4b3e-a735-107c14aee1a7 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a31585e0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.443001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-e8e63789-5305-4631-9220-e4cb07216bb6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] HTTP exception thrown: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e8e63789-5305-4631-9220-e4cb07216bb6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Request method failure captured: May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b HTTP/1.1 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNIVvfyYzrjYJQeAp1Li3rYiuYijIg_0x0cOt6fjZycYxmXRAV_za02FK3nWvi0IWHqcd-I2Av2HdEsMH2QtNCgm3GFlM8g_kD8hpFmQHOtFcEuN2niCFeYcs5jYA4CbGZrzuze7-oL4PSSJh5LJtJJJFgdyHHOq8DnU1-HVsuG0GY May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:06:43.445342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c7e4c2961f55482491f6194da650b479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c7e4c2961f55482491f6194da650b479", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c7e4c2961f55482491f6194da650b479"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: c7e4c2961f55482491f6194da650b479 May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-356003428 May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 73143527412b430bb7cfbcd8399ed646 May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesSnapshotsTestJSON-356003428-project May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'bc745524-b836-43b8-af50-0ae651610d5b'} May 30 12:06:43.446377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. (HTTP 404) (Request-ID: req-98559a66-45fb-4183-90e3-3729e6ef54fd) May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.447097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:06:43.448025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:06:43.448973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. May 30 12:06:43.449832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:06:43.453592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e8e63789-5305-4631-9220-e4cb07216bb6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] Returning 404 to user: Volume bc745524-b836-43b8-af50-0ae651610d5b could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:06:43.454677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e8e63789-5305-4631-9220-e4cb07216bb6 tempest-VolumesSnapshotsTestJSON-356003428 tempest-VolumesSnapshotsTestJSON-356003428-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b" status: 404 len: 109 microversion: 2.1 time: 0.112495 May 30 12:06:43.459020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 23/37] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/bc745524-b836-43b8-af50-0ae651610d5b => generated 109 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:06:43.521361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1efae7da-c6e9-4b3e-a735-107c14aee1a7 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.145618 May 30 12:06:43.522232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 15/38] 10.222.0.41 () {58 vars in 1154 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:43.538582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ba418c03-4f3d-4407-ac92-27d0496cfb48 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a39c78b0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:43.823736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ba418c03-4f3d-4407-ac92-27d0496cfb48 tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.293140 May 30 12:06:43.824986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 24/39] 10.222.0.41 () {58 vars in 1187 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:06:43.845704 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bf7814b8-f75f-4a34-b8f9-fe3bf27921da tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] Calling method '.version_select at 0x7f61a3a29670>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:44.093149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bf7814b8-f75f-4a34-b8f9-fe3bf27921da tempest-VolumesTestJSON-2094190366 tempest-VolumesTestJSON-2094190366-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.259682 May 30 12:06:44.106232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 16/40] 10.222.0.41 () {58 vars in 1154 bytes} [Mon May 30 12:06:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:44.280472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:44.281093 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:44.298480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.304520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.306694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:44.311027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:44.862353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:44.879614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2a3594b8-c195-4f05-b63c-f811163780db tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1218 microversion: 2.1 time: 0.604126 May 30 12:06:44.900882 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 25/41] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:44 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1218 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:45.901014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:45.902121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:45.939756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:45.944568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:45.946531 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:45.949419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:46.306926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:46.327379 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4cdef152-e0c6-4262-9514-d7cc91028d89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1274 microversion: 2.1 time: 0.431679 May 30 12:06:46.330492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 17/42] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:45 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1274 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:47.349243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:47.350088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:47.366757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.369937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.373321 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:47.373810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:47.795151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:47.809798 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d0133510-f089-4646-a676-2ba15e4b0f89 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1272 microversion: 2.1 time: 0.466945 May 30 12:06:47.826460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 26/43] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:47 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1272 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:48.830767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:48.832935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:48.849259 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.849877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.852141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:48.853041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:48.968963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-207c804b-ff82-4005-9372-2cb54d049b17 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: .version_select at 0x7f61a2089670>, body: {"keypair": {"name": "tempest-keypair-321243116", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFHWg44jGkXOyPvrisY8tyIXi3R1BL+ApKPz6/rNEGBQdUCBLkChZ+u+KmaO+e/24dJhC0SUSdc0u3FlfyKS9iLkCK+NSMEXj07XXjbimlxY5TuTtevkJSJGsnCv1e6meg=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:49.057732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-207c804b-ff82-4005-9372-2cb54d049b17 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for project 185231fbe57e438a9ee70b39991235b2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:49.073524 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-207c804b-ff82-4005-9372-2cb54d049b17 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for user 9c9292fdef7f41af8fcb9375ce1764e2 and project 185231fbe57e438a9ee70b39991235b2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:49.092571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:49.123749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4690bcc9-da3e-485c-9b20-cc97bd28407b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1272 microversion: 2.1 time: 0.298436 May 30 12:06:49.135957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 27/44] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:48 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:49.175150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-581868059", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc42f6ba-36b7-432a-8fd7-6b1f2c279d11"}], "security_groups": [{"name": "tempest-securitygroup--923456503"}], "key_name": "tempest-keypair-796694744", "user_data": "}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:49.178835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-207c804b-ff82-4005-9372-2cb54d049b17 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.807612 May 30 12:06:49.179615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 18/45] 10.222.0.41 () {62 vars in 1199 bytes} [Mon May 30 12:06:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 809 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 30 12:06:50.147482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:06:50.216917 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] validate_networks() for [('bc42f6ba-36b7-432a-8fd7-6b1f2c279d11', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:50.562935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-60d43623-3eaa-4677-a85f-843e459ee7df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: .version_select at 0x7f61a2041f70>, body: {"keypair": {"name": "tempest-keypair-1783926552", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5P1sVZK4deDRfuTKPhUZtVzGZE8z5wNPMEt00lR/H8wOi4HBror/xl2BXSFMTT8sTN1KOJTNdot/jcmNuf87+hiWTiN2e6Z/cAKKRQgBy1LyiiF7RwLcPHEZ6n8GRnwg=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:50.635663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-60d43623-3eaa-4677-a85f-843e459ee7df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for project 63d6c4272b654ba18d854527b14b1a88. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:50.641307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-60d43623-3eaa-4677-a85f-843e459ee7df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for user 5ee1e385f10e4ed4849ef2febc22e497 and project 63d6c4272b654ba18d854527b14b1a88. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:50.701934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-60d43623-3eaa-4677-a85f-843e459ee7df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.987453 May 30 12:06:50.720790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 19/46] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:06:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:06:50.735900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:50.737195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:50.759190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:50.759771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:50.760693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:50.761291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:51.199706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:51.209543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fdf65c01-6dd5-4261-b1b9-f171612e6819 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.483645 May 30 12:06:51.210686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 20/47] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:50 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:52.227134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:52.228602 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:52.238943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.239865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.241024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.241858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.314751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:52.315520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:52.315777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:52.316841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:52.317439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:52.331655 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.332409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.333586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:52.334036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:52.373437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:52.400000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:52.416846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:52.422143 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:52.522678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:52.539448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f31a84f1-e36a-459c-b578-664045f38315 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.316755 May 30 12:06:52.555726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 21/48] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:52 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:52.647233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a8720d22-294d-4060-9bef-882573c2ef49 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.478399 May 30 12:06:52.651751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 28/49] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:06:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:06:52.665244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bb396aca-a9c2-42be-b0de-7225aedc90a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:52.666120 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bb396aca-a9c2-42be-b0de-7225aedc90a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:52.771255 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bb396aca-a9c2-42be-b0de-7225aedc90a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:52.790635 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bb396aca-a9c2-42be-b0de-7225aedc90a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1240 microversion: 2.1 time: 0.129245 May 30 12:06:52.805697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 22/50] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:52 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1240 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:53.565486 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:53.566368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:53.587132 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.587601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.588440 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:53.588982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:53.808868 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-560906db-ad8a-4e4d-8337-b583cb28d5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:53.809687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-560906db-ad8a-4e4d-8337-b583cb28d5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:54.271588 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-560906db-ad8a-4e4d-8337-b583cb28d5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:54.279702 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-560906db-ad8a-4e4d-8337-b583cb28d5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1240 microversion: 2.1 time: 0.475202 May 30 12:06:54.294012 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 23/51] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:53 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1240 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:06:55.274352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:55.303247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-093cfa20-c1bb-46c5-83ec-0186161cf4bd tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 1.737601 May 30 12:06:55.304004 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 29/52] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:53 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:55.313501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:55.314933 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:55.337392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:55.343473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:55.346731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:55.348609 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:55.723581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:55.744318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fc222b1f-9df0-4573-969b-f0a1fb34171f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1236 microversion: 2.1 time: 0.428283 May 30 12:06:55.760619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 24/53] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:55 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1236 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:56.324311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:56.325177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:56.338216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.344569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:56.347199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.350189 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:56.547133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1497931164", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb58b71f-baeb-455b-a553-e207f4ef1e81"}], "security_groups": [{"name": "tempest-securitygroup--1340868748"}], "key_name": "tempest-keypair-1783926552", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:56.885806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:56.904117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-40ee8b3d-275e-43a1-94fc-e0334e97b72d tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.585477 May 30 12:06:56.906709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 30/54] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:56 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:56.918686 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:56.927584 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:56.957986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.958459 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:56.963773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:56.964254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:57.299782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:06:57.310126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-575565bf-1d97-429e-8454-349340297722 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1310 microversion: 2.1 time: 0.401228 May 30 12:06:57.317760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 31/55] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:56 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1310 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:06:57.325637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1635620399", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0267d625-b0e5-4dff-a6d4-b0221d482c6b"}], "security_groups": [{"name": "tempest-securitygroup--862030173"}], "key_name": "tempest-keypair-321243116", "user_data": "}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:06:57.482979 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] validate_networks() for [('fb58b71f-baeb-455b-a553-e207f4ef1e81', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:58.029376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] validate_networks() for [('0267d625-b0e5-4dff-a6d4-b0221d482c6b', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:06:58.343237 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:58.344446 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:58.345183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:58.345741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:58.346362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:58.366114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.366563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:58.367371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.395469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:58.468089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for project 63d6c4272b654ba18d854527b14b1a88. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:58.479562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for user 5ee1e385f10e4ed4849ef2febc22e497 and project 63d6c4272b654ba18d854527b14b1a88. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:58.501101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:58.506414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:06:58.684331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3789de8f-25bc-4b59-b764-c19f64ee20e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.143500 May 30 12:06:58.694319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 25/56] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:06:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:06:58.710538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:06:58.711169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:06:58.767098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.770626 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:58.796435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:58.797200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:59.817118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:06:59.817718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:06:59.818107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:06:59.818692 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:06:59.819407 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:06:59.847991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:59.848923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:59.849893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:06:59.850498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:06:59.870328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for project 185231fbe57e438a9ee70b39991235b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:06:59.877225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for user 9c9292fdef7f41af8fcb9375ce1764e2 and project 185231fbe57e438a9ee70b39991235b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:06:59.892766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:06:59.896364 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:07:00.014843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-77e6d43b-50ec-4b77-8213-f0c8582602e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.693050 May 30 12:07:00.021421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 32/57] 10.222.0.41 () {62 vars in 1187 bytes} [Mon May 30 12:06:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 30 12:07:00.042480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:00.045331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:00.062602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.063078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:00.063905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.068423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:00.382007 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:00.394248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e183dc66-f75a-4995-baa9-b6a92ee51165 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1298 microversion: 2.1 time: 0.369486 May 30 12:07:00.398129 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 33/58] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:00 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:00.408852 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:00.410543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:00.430658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.431338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:00.433907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:00.434518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:00.698820 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:00.715383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cd8bb5c5-4531-4cc5-b246-268773252a84 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1234 microversion: 2.1 time: 0.310313 May 30 12:07:00.716285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 34/59] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:00 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1234 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:00.742933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:00.743731 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:00.906793 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:00.918177 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-58586492-3f7e-4ce6-8a18-bd71ddd17120 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 2.218862 May 30 12:07:00.919078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 26/60] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:06:58 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 2224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:01.037390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.052595 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.054160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:01.070353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-08d2a834-1586-4eb4-9dfd-802a92382935 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1281 microversion: 2.20 time: 0.351907 May 30 12:07:01.075239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 35/61] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:00 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1281 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:01.106765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-227a68dc-ef3e-4a64-9bb2-a0dbfda22367 req-9d53302e-62ac-453c-a2af-08179112a732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87172ed-2fce-4938-beb7-5ef69157c3e5", "tag": "630a855c-7b0d-4661-be0f-d5b31ffd1801"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:01.148577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-227a68dc-ef3e-4a64-9bb2-a0dbfda22367 req-9d53302e-62ac-453c-a2af-08179112a732 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.149455 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-227a68dc-ef3e-4a64-9bb2-a0dbfda22367 req-9d53302e-62ac-453c-a2af-08179112a732 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.208851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-227a68dc-ef3e-4a64-9bb2-a0dbfda22367 req-9d53302e-62ac-453c-a2af-08179112a732 service nova] Creating event network-changed:630a855c-7b0d-4661-be0f-d5b31ffd1801 for instance b87172ed-2fce-4938-beb7-5ef69157c3e5 on hv-cinder-83979 May 30 12:07:01.211747 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-227a68dc-ef3e-4a64-9bb2-a0dbfda22367 req-9d53302e-62ac-453c-a2af-08179112a732 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 30 12:07:01.213436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.215738 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.218916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.221316 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.249625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.compute.rpcapi [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 30 12:07:01.250788 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] Releasing lock "compute-rpcapi-router" {{(pid=117705) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 30 12:07:01.303664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-638d9f7d-00a1-432f-a4e2-92e64ea8ade5 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378289 May 30 12:07:01.304692 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 27/62] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:01.421648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:01.423080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:01.454346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.455518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.458472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.461805 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.735307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:01.736200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:01.760106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.760985 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:01.763127 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:01.779886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.248733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.258883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4796b54c-5082-4c9f-a72f-1518fef879cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1308 microversion: 2.1 time: 0.529157 May 30 12:07:02.264341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 28/63] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:01 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1308 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:02.272489 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.275849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:02.277504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:02.289663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.290241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-acbe9e77-46e3-452c-80b8-3f21f9a32b44 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.881219 May 30 12:07:02.290839 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 36/64] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:01 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:02.293219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.297243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.297881 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.326792 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:02.327531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:02.359269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.364132 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.364995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:02.368773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:02.813346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.840960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.852755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.856118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d0ff4d83-e82d-484b-acf9-98e722035b0a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1333 microversion: 2.20 time: 0.545497 May 30 12:07:02.859881 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 37/65] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:02 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1333 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:02.873087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:02.903207 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ba560b95-57ac-4c6f-a9e2-628cb8baed8c tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.636004 May 30 12:07:02.905559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 29/66] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:02 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:03.278750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:03.280243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:03.283272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:03.288758 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.289192 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.308185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:03.309555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:03.313033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=9 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:03.314836 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.315670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.333991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.341747 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.345497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.346143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.368224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=51 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:03.667724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:03.680365 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2a8e6425-881f-41bc-a175-76dc2f543bfe tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1296 microversion: 2.1 time: 0.405567 May 30 12:07:03.688679 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 38/67] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:03 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1296 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:03.880705 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:03.881428 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:03.903896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.904438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:03.905230 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:03.905662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.350290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.363990 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.365732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.371314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7339123f-38ff-4d7f-afa0-06bf3f41f234 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1339 microversion: 2.20 time: 0.498215 May 30 12:07:04.371915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 39/68] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:03 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1339 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:04.401642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:04.403306 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:04.431166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.433394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.435249 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.437293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.508648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.523300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c5526bfd-71eb-413b-827b-4f94aa6565f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 1.217473 May 30 12:07:04.527521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 30/69] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:03 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:04.711643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:04.712576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:04.734967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.735583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.736764 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:04.738463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:04.941629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:04.955895 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-413049c3-8c68-46d4-9d44-fc82f90530d5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1296 microversion: 2.1 time: 0.253131 May 30 12:07:04.965926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 31/70] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:04 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1296 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:05.394290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:05.395118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:05.402671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.403307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.404462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.405153 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.434990 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.462461 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c341b002-9b52-4533-b13a-7ae17b8f1545 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 1.087150 May 30 12:07:05.465638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 40/71] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:04 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:05.546353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:05.548496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:05.579410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.580484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.582371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.582958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.605098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.621975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.625576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:05.631968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3b9a9980-4454-43aa-9dd5-39de2f8dfe1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1339 microversion: 2.20 time: 0.242334 May 30 12:07:05.636009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 32/72] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:05 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1339 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:05.977709 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:05.978449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:05.988640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.989229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:05.991544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:05.992109 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.075027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:06.084783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:06.097013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f8c12884-b165-4e5b-b2dd-5f12359c55ca tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.556121 May 30 12:07:06.099439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ef54d920-2d2b-4706-856a-5ab8353b7e08 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1296 microversion: 2.1 time: 0.126584 May 30 12:07:06.107715 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 41/73] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:05 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:06.114124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 33/74] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:05 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1296 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:06.413779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-50239459-6969-4896-b6bd-2a2196474dbf req-09171b75-f185-4602-a5fa-51f3bebf99b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5505ae9e-14bf-49a2-9e34-b42e866bb86f", "tag": "d263c2ea-94ff-4515-becb-13b8808cda29"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:06.432658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-50239459-6969-4896-b6bd-2a2196474dbf req-09171b75-f185-4602-a5fa-51f3bebf99b2 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.434015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-50239459-6969-4896-b6bd-2a2196474dbf req-09171b75-f185-4602-a5fa-51f3bebf99b2 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.480884 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:06.481813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:06.493776 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.496411 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.499166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.499591 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.506063 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-50239459-6969-4896-b6bd-2a2196474dbf req-09171b75-f185-4602-a5fa-51f3bebf99b2 service nova] Creating event network-changed:d263c2ea-94ff-4515-becb-13b8808cda29 for instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f on hv-cinder-83979 May 30 12:07:06.511501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-50239459-6969-4896-b6bd-2a2196474dbf req-09171b75-f185-4602-a5fa-51f3bebf99b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 30 12:07:06.521872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.522661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.523675 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.524316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.538366 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.compute.rpcapi [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 30 12:07:06.540300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] Releasing lock "compute-rpcapi-router" {{(pid=117706) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 30 12:07:06.566069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cba38389-8ec8-45e3-ace5-d7638cb1d85e None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.455540 May 30 12:07:06.566927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 42/75] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:06.651713 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:06.652874 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:06.661325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.666149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:06.667359 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:06.668385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.095764 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.104265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.108374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.115212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.116453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-366d6b4e-0a87-43b7-beb8-221974ba1f31 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.469845 May 30 12:07:07.116913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fca00f32-88d9-4375-b478-b3579c004aab tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.639802 May 30 12:07:07.117377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 43/76] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:06 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:07.123782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:07.124416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:07.130426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 34/77] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:06 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:07.142002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:07.142699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:07.143626 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:07.144576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.145210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:07.145661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.150120 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:07.158611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:07.161923 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.165159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:07.165890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:07.405097 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.416559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5610758a-1957-463e-b6e8-b2e724121848 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.284735 May 30 12:07:07.417144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 35/78] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:07 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:07.966934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:07.978617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-69ece6ca-0572-4641-b168-d9e6ae9d4933 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.860123 May 30 12:07:07.980279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 44/79] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:07 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:08.135171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:08.135787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:08.136277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:08.137105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:08.143094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.143582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.147976 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.150967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.151784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.152809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.153563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.153742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.399430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.413587 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ef0c8577-3f4b-4e8a-8a59-a60c1c355211 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.282368 May 30 12:07:08.415014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 36/80] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:08 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:08.437174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:08.438215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:08.470042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.473974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.475016 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:08.480031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:08.495071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=28 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:08.751632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.764938 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d50df89d-21e7-4755-9bba-a7ca88bd0e98 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.333915 May 30 12:07:08.770287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 37/81] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:08 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:08.777265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.787603 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.803584 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:08.806075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6f6b2cf8-1e30-4e74-bca8-fbc5ea33def3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.674979 May 30 12:07:08.807528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 45/82] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:08 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:09.053329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:09.054150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:09.094467 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.104596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.105674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.106176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.309125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:09.325625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-69be645a-b0c7-4f66-91a0-0b03c208b2d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.304607 May 30 12:07:09.328827 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 38/83] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:09 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:09.434596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:09.435468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:09.448543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.449772 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.450829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.451427 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.787188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:09.788075 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:09.799074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.799544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:09.801168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:09.801667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.048171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.059610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e3ba279b-537a-4a66-a1c8-0e447be14ad5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.275053 May 30 12:07:10.060597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 39/84] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:09 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:10.073489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:10.074329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:10.088495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.090047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.093295 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.093902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.210861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.224711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b6dca00e-ff04-468f-9294-719b2eb30f99 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.797399 May 30 12:07:10.230867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 46/85] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:09 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:10.245569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-53626241-5b88-43c7-96c1-098ca5542e2c req-5875bb5a-fd5b-4e8a-bdfa-8d1373063a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74de07ed-a2fe-45f8-ac09-ec21741046db", "tag": "025b3ade-423e-4cd4-ba87-23078118b6b9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:10.289797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-53626241-5b88-43c7-96c1-098ca5542e2c req-5875bb5a-fd5b-4e8a-bdfa-8d1373063a19 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.290559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-53626241-5b88-43c7-96c1-098ca5542e2c req-5875bb5a-fd5b-4e8a-bdfa-8d1373063a19 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.329156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.329661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-53626241-5b88-43c7-96c1-098ca5542e2c req-5875bb5a-fd5b-4e8a-bdfa-8d1373063a19 service nova] Creating event network-changed:025b3ade-423e-4cd4-ba87-23078118b6b9 for instance 74de07ed-a2fe-45f8-ac09-ec21741046db on hv-cinder-83979 May 30 12:07:10.342944 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-53626241-5b88-43c7-96c1-098ca5542e2c req-5875bb5a-fd5b-4e8a-bdfa-8d1373063a19 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109305 May 30 12:07:10.345018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.345943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 47/86] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:10.347694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.349575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b0472f09-d7f2-46e5-992c-eec0ae560810 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.285480 May 30 12:07:10.351793 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 40/87] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:10 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:10.385678 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:10.395149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:10.426535 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.426993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.432779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:10.435298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:10.699173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:10.709048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e3c882d5-c7fb-4eac-bca0-c56c163d183a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.337308 May 30 12:07:10.718956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 48/88] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:10 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:11.077760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:11.078642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:11.087608 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.088224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.089240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.089686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.229950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.244645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:11.245421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:11.247722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=18 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:11.249929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:11.254019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.256975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8a83e300-8189-4124-8f9e-96880c9aa5d9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.183617 May 30 12:07:11.257119 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.258247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.259497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.267488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 41/89] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:11 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:11.374485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:11.375131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:11.386582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.387407 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.388598 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.389648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.606204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.624732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.626249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.636089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f48f5c2f-21fa-4c90-8ffd-951e50911fdf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.265966 May 30 12:07:11.636718 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 42/90] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:11 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:11.817823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-fb52653f-68b0-495b-aee4-ba5ad3c91527 req-5ba060ef-7f6e-4571-ac4b-42fcca7f8460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87172ed-2fce-4938-beb7-5ef69157c3e5", "name": "network-vif-plugged", "status": "completed", "tag": "630a855c-7b0d-4661-be0f-d5b31ffd1801"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:11.857013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-fb52653f-68b0-495b-aee4-ba5ad3c91527 req-5ba060ef-7f6e-4571-ac4b-42fcca7f8460 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.857487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-fb52653f-68b0-495b-aee4-ba5ad3c91527 req-5ba060ef-7f6e-4571-ac4b-42fcca7f8460 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.903243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-fb52653f-68b0-495b-aee4-ba5ad3c91527 req-5ba060ef-7f6e-4571-ac4b-42fcca7f8460 service nova] Creating event network-vif-plugged:630a855c-7b0d-4661-be0f-d5b31ffd1801 for instance b87172ed-2fce-4938-beb7-5ef69157c3e5 on hv-cinder-83979 May 30 12:07:11.914288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-fb52653f-68b0-495b-aee4-ba5ad3c91527 req-5ba060ef-7f6e-4571-ac4b-42fcca7f8460 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199452 May 30 12:07:11.919812 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 43/91] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:11.927080 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:11.928970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:11.936154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.938364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.939699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:11.941672 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:11.979502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:11.996712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d877a3fa-6506-4bbe-9696-2b2904f1571a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.755864 May 30 12:07:11.997774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 49/92] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:11 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:12.275484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:12.276138 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:12.304256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.306311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.307790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.309062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.310848 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.332006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-210b49b1-db11-4230-a253-2458a24d72fa tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.409731 May 30 12:07:12.337189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 44/93] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:11 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:12.401534 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-2da2ca5b-dea6-4dc7-92dc-dc3a1f81d373 req-46b67c7c-f9b6-439f-b6d1-4edfb0e1fce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:12.410890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2da2ca5b-dea6-4dc7-92dc-dc3a1f81d373 req-46b67c7c-f9b6-439f-b6d1-4edfb0e1fce3 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.415206 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2da2ca5b-dea6-4dc7-92dc-dc3a1f81d373 req-46b67c7c-f9b6-439f-b6d1-4edfb0e1fce3 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.447997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-2da2ca5b-dea6-4dc7-92dc-dc3a1f81d373 req-46b67c7c-f9b6-439f-b6d1-4edfb0e1fce3 service nova] Creating event network-changed:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:07:12.458967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-2da2ca5b-dea6-4dc7-92dc-dc3a1f81d373 req-46b67c7c-f9b6-439f-b6d1-4edfb0e1fce3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061568 May 30 12:07:12.462238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 45/94] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:12.638780 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.660208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:12.663466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:12.671156 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-aa5df5ce-e02f-41d1-b8f1-7268089c661d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.400003 May 30 12:07:12.672870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 50/95] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:12 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:12.688426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.689348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.690287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:12.690732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:12.916090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.926022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.927597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:12.928761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f3cfa913-ef0b-4d18-8e1b-aa26877f5a48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.276100 May 30 12:07:12.929970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 46/96] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:12 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:13.014864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:13.015615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:13.022546 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.023145 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.024232 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.024923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.186416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:13.195554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-857bd069-6158-479a-bc83-f9ef6a4c3ddb tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.184767 May 30 12:07:13.196310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 51/97] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:13 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:13.355217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:13.356019 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:13.369138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.379234 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.380674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.381137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.671880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:13.683699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ea8b86ae-f867-4573-9664-35a57d37c4af tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.333662 May 30 12:07:13.687466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 47/98] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:13 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:13.693703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:13.694728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:13.706170 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.707309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.708530 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.710588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.921638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:13.936342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4cb448b6-1ed1-4320-a7f0-966c5039ae04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.247394 May 30 12:07:13.956347 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:13.957880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:13.962311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 52/99] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:13 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:13.969753 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.970364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:13.973684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:13.974400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.045351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:14.213592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:14.214260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:14.223177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.224361 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.225352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.225995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.280467 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.290951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.293422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.294828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9923e44f-f859-4f8f-8cb1-57018a302df7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.344856 May 30 12:07:14.296306 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 48/100] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:13 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:14.453609 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.462629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-96b16c53-dbce-472f-b989-15590a9301b3 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.253075 May 30 12:07:14.472467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 53/101] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:14 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:14.703646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:14.704297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:14.710501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.710958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.711729 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.712199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.861839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:14.871437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-33e82cef-1ef5-48c7-a963-5a0c5c9a07f7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.171319 May 30 12:07:14.881351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 49/102] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:14 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:14.958838 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:14.959795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:14.965976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.966500 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:14.967345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:14.967874 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.193647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.202739 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-43ce67a7-be50-461e-b915-44511761f396 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.247367 May 30 12:07:15.204015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 54/103] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:14 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:15.314442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:15.315136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:15.321878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.322336 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.323308 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.323749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.481369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:15.481987 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:15.491766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.492250 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.493042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.496441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.551678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.579456 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.583180 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.589560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-95030647-d1f7-493b-bbdb-d9064813b3c7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.274697 May 30 12:07:15.592043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 50/104] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:15 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:15.695079 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:15.704271 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4b225873-f2a0-4415-bbe7-be511228f06b tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.226636 May 30 12:07:15.716984 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 55/105] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:15 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:15.888870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:15.889482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:15.896697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.897428 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:15.898418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:15.899056 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.046317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.057361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-64286b57-ea0e-4318-a480-ac3abb2d8dd7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.172382 May 30 12:07:16.058297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 51/106] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:15 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:16.220709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:16.221905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:16.228206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.228915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.229888 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.230503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.384658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.392821 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-502ffcb1-7c62-4044-b01d-ea87abbbd45a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.175975 May 30 12:07:16.393714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 56/107] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:16 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:16.618486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:16.619096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:16.625140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.625590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.626346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.626775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.727421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:16.728149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:16.736001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:16.738490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.739006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.739703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:16.740164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:16.840016 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.853959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.856002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.857546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-03fda1f4-941e-46fd-9613-73f17e957f54 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.252249 May 30 12:07:16.859033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 52/108] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:16 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:16.927168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:16.936496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a53d3929-e1ef-46f3-8657-fff9bb8e06d4 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.213140 May 30 12:07:16.937276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 57/109] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:16 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:17.074169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:17.074802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:17.081268 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.082271 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.083030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.083459 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.215208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:17.222500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1e2bb704-a240-48b1-b411-dc67d74d1141 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.152108 May 30 12:07:17.223067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 53/110] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:17 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:17.410336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:17.411015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:17.416953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.417398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.418207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.418640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.493146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-cb0bb05d-d66a-4aaa-b5d5-929b9577b823 req-5f4bbf7a-f831-4f42-bf0b-a1c993072a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5505ae9e-14bf-49a2-9e34-b42e866bb86f", "name": "network-vif-plugged", "status": "completed", "tag": "d263c2ea-94ff-4515-becb-13b8808cda29"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:17.503514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-cb0bb05d-d66a-4aaa-b5d5-929b9577b823 req-5f4bbf7a-f831-4f42-bf0b-a1c993072a4c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.505242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-cb0bb05d-d66a-4aaa-b5d5-929b9577b823 req-5f4bbf7a-f831-4f42-bf0b-a1c993072a4c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.519054 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-cb0bb05d-d66a-4aaa-b5d5-929b9577b823 req-5f4bbf7a-f831-4f42-bf0b-a1c993072a4c service nova] Creating event network-vif-plugged:d263c2ea-94ff-4515-becb-13b8808cda29 for instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f on hv-cinder-83979 May 30 12:07:17.525085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-cb0bb05d-d66a-4aaa-b5d5-929b9577b823 req-5f4bbf7a-f831-4f42-bf0b-a1c993072a4c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035306 May 30 12:07:17.526328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 54/111] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:17.583349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:17.591166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c8ada586-085d-4caa-83ff-effb0431bfa2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.185158 May 30 12:07:17.591879 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 58/112] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:17 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:17.879252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:17.881509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:17.889353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.890049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.891021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.892049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.955165 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:17.956200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:17.971864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.973973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:17.975171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:17.977840 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.175066 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.183979 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.185761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.187094 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4348032e-b9fc-4131-9d4c-a436f891d299 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.314493 May 30 12:07:18.198766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 55/113] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:17 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:18.239795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:18.240484 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:18.250501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.251663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.253230 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.253908 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.402935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.411667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c3aad29d-36c2-4187-9c9c-187bb0c6b298 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.177019 May 30 12:07:18.412365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 56/114] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:18 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:18.589573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.598213 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4935755f-cb65-4e47-bc8d-3073b2edf5d5 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.648350 May 30 12:07:18.598787 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 59/115] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:17 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:18.608612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:18.609577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:18.615716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.616202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.616965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:18.617399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:18.749286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:18.757302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2e984839-cf73-43c8-acda-171ec617ca44 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.152507 May 30 12:07:18.757862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 57/116] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:18 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:19.205267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:19.205906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:19.211867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.212398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.213176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.213619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.357751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.369239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.371950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.375460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-dd91d5ed-9699-4954-bc4d-8adfc2923d2e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.174200 May 30 12:07:19.384617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 60/117] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:19 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:19.428472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:19.429091 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:19.435490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.436055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.436860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.437469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.582644 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.590067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-652c75af-de6a-43a8-9c41-65bdda4063c1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.165434 May 30 12:07:19.590627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 58/118] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:19 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:19.615914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:19.616525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:19.622561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.623010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.623764 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.624231 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.644448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:19.756179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.763973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-dbff5b94-5769-41d3-9e27-57dc8adff563 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.151984 May 30 12:07:19.764556 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 61/119] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:19 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:19.780238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:19.780855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:19.787916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.788235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.789004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:19.789442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:19.917912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:19.925444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5b2e0d01-9270-48a8-8c85-be93ef39f3ad tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.149030 May 30 12:07:19.926007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 59/120] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:19 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:20.394920 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.395533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.401639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.402099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.402866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.403304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.530766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.540332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.542248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.543362 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fc8637af-5d1b-4c74-9816-6f53153f4e9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.153158 May 30 12:07:20.543946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 62/121] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:20 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:20.607039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.607722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.614959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.615403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.616191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.616631 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.746241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.754066 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7b4527de-be74-429f-ae0c-659c5c0425c7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.150830 May 30 12:07:20.754621 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 60/122] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:20 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:20.781102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.781713 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.787961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.788409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.789166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.789601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.933252 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:20.940773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-060194d2-d459-4415-8791-27d83010676a tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1314 microversion: 2.1 time: 0.163404 May 30 12:07:20.941340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 63/123] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:20 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:20.941965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:20.942636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:20.948869 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.949244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:20.950015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:20.950458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.075978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.083370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-36c282b2-710f-4e6c-baf6-4a45eab47d92 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.145158 May 30 12:07:21.083959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 61/124] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:20 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:21.561896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:21.562506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:21.568958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.569430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.570188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.570617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.705385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.718019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.719963 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.721732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4a4c8f0d-e49f-4b7a-a97b-ce88eb6c0f6a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.163690 May 30 12:07:21.732746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 64/125] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:21 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:21.771055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:21.771663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:21.789833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.790478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.791498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.792566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.944564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:21.953260 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0266bcee-3266-447e-add5-446b9ec0b104 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.186516 May 30 12:07:21.953836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 62/126] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:21 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:21.958046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:21.959098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:21.965378 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.965914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:21.966784 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:21.967455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.101038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:22.101661 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:22.108137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.108586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.110366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.110825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.121151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.130071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-457ce892-001d-41e2-83af-db439506d902 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1502 microversion: 2.1 time: 0.176517 May 30 12:07:22.130946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 65/127] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:21 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:22.282709 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.291740 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e5dc6de9-81fc-4fa3-9e1c-a685cbfde3e1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.195319 May 30 12:07:22.292902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 63/128] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:22 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:22.741514 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:22.742571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:22.749826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.750629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.751776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.753141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.908057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.917372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.918954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:22.920157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9683137b-3157-42f2-9f8f-8198bbc398ed tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.183725 May 30 12:07:22.920809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 66/129] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:22 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:22.970420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:22.972981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:22.980278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.981105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:22.981857 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:22.982310 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.182135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.189627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b3e2eff9-2feb-4b9d-b977-d56a5b135eb2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.223160 May 30 12:07:23.190895 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 64/130] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:22 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:23.311952 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:23.312559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:23.320241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.320696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.321457 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.321889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.463564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:23.471594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-35de46f3-0977-4cfa-a6bd-208ad8788414 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.165462 May 30 12:07:23.472214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 67/131] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:23 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:23.544663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80d7e104-54f4-49bc-88a7-50087bbc0d28"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:23.545781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:23.552174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.552625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.553382 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.553819 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.612526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:23.938478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:23.939088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:23.945127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.945570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:23.946307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:23.946741 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.213805 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.222242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.223786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.224901 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-643b180d-6001-460d-ab48-1123e3c32587 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.290236 May 30 12:07:24.225459 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 68/132] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:23 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:24.229722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:24.230329 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:24.236114 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.236562 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.237941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.238374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.369008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.377448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-897f82d0-2c78-4696-9fea-b3667df01afc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.150975 May 30 12:07:24.378168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 69/133] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:24 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:24.488805 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:24.489352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:24.495353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.495873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.496687 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:24.497124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:24.625134 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:24.633150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-312f940b-1485-4178-b9dc-9c546b59a90f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.148766 May 30 12:07:24.633706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 70/134] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:24 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:25.242964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:25.243579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:25.249645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.250097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.250859 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.251298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.382214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.390087 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.391574 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.392687 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-856e418b-abf9-4a41-bf7d-e67ae5f0c649 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.153576 May 30 12:07:25.393601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 71/135] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:25 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:25.397650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:25.398243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:25.403977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.404419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.405173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.405602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.535863 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.543251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-311ee86c-1276-467e-9174-c94de76221d6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.148952 May 30 12:07:25.543809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 72/136] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:25 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:25.649088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:25.649693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:25.655563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.656048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.656801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:25.657236 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:25.785319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:25.792688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f3299550-f36d-417a-9d2c-9f23bca8ed8d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.147305 May 30 12:07:25.793251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 73/137] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:25 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:07:26.411439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:26.412417 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:26.420324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.420767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.421583 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.421977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.583226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:26.591488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:26.593144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:26.594285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-90896f56-6759-4216-b7b8-8ce34485001b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.187614 May 30 12:07:26.594841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 74/138] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:26 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:26.600196 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:26.600807 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:26.607614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.608109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.608877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.609568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.847741 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:26.855537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-91d52487-9a18-456c-b5ae-5d7f17ab4999 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1365 microversion: 2.1 time: 0.259665 May 30 12:07:26.856513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 75/139] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:26 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:26.861893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-939094ae-47cc-4c61-9ddb-69a01eb32704 req-22a574bf-8b0f-43d1-8e78-ba3103d31fdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "name": "network-vif-plugged", "status": "completed", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:26.872070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-939094ae-47cc-4c61-9ddb-69a01eb32704 req-22a574bf-8b0f-43d1-8e78-ba3103d31fdb service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.873004 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-939094ae-47cc-4c61-9ddb-69a01eb32704 req-22a574bf-8b0f-43d1-8e78-ba3103d31fdb service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.886972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-939094ae-47cc-4c61-9ddb-69a01eb32704 req-22a574bf-8b0f-43d1-8e78-ba3103d31fdb service nova] Creating event network-vif-plugged:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:07:26.893442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-939094ae-47cc-4c61-9ddb-69a01eb32704 req-22a574bf-8b0f-43d1-8e78-ba3103d31fdb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035521 May 30 12:07:26.894747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 76/140] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:26.902335 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:26.903724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:26.913091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.913746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:26.914648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:26.915334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.042779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-09422c03-d029-47e8-9dbc-47859e345cc0 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "POST /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.501789 May 30 12:07:27.043537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 65/141] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:07:23 2022] POST /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5/os-volume_attachments => generated 194 bytes in 3504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:27.095029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.103392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-65d921e8-6fca-4d89-b4ca-c7584d1d76a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.207193 May 30 12:07:27.103994 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 77/142] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:26 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:27.615383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:27.616141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:27.626994 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:27.628567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.629584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:27.630048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.874367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:27.876269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:27.884675 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:27.885125 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.886136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:27.886910 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:27.925259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.937371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.938880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:27.940365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-879fc33f-51d4-49ee-b8f2-96220e708910 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.329737 May 30 12:07:27.941101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 66/143] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:27 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:28.030692 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:28.035071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:28.040384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-782f0201-57dd-4dca-94ca-4bea505ef9a7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1555 microversion: 2.1 time: 0.171039 May 30 12:07:28.040956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 78/144] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:27 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1555 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:28.058082 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:28.058582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:28.064606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.065235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.066222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.066657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.122720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:28.123844 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:28.135152 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.135807 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.136757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.137293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.148714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-91e75f19-43cf-40fc-a118-e72823d14dc5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094306 May 30 12:07:28.149301 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 67/145] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:07:28 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:28.516484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:28.525277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1ad15ce1-c768-4f22-a555-427222a8df9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.406996 May 30 12:07:28.526280 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 79/146] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:28 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:28.936386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-589cfbdd-0ec4-4cde-8785-e77e97d32b8c req-24f39b86-907a-48d6-9602-7b45d1a024c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74de07ed-a2fe-45f8-ac09-ec21741046db", "name": "network-vif-plugged", "status": "completed", "tag": "025b3ade-423e-4cd4-ba87-23078118b6b9"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:28.952199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-589cfbdd-0ec4-4cde-8785-e77e97d32b8c req-24f39b86-907a-48d6-9602-7b45d1a024c1 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.952688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-589cfbdd-0ec4-4cde-8785-e77e97d32b8c req-24f39b86-907a-48d6-9602-7b45d1a024c1 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.958696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:28.959354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:28.973467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.976100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.977012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:28.982434 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:28.990958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-589cfbdd-0ec4-4cde-8785-e77e97d32b8c req-24f39b86-907a-48d6-9602-7b45d1a024c1 service nova] Creating event network-vif-plugged:025b3ade-423e-4cd4-ba87-23078118b6b9 for instance 74de07ed-a2fe-45f8-ac09-ec21741046db on hv-cinder-83979 May 30 12:07:29.007300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-589cfbdd-0ec4-4cde-8785-e77e97d32b8c req-24f39b86-907a-48d6-9602-7b45d1a024c1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084032 May 30 12:07:29.008493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 68/147] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:29.304070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.313149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.315215 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.316377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-30e2ba54-9473-4bbb-8ebe-46d01983644c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1406 microversion: 2.20 time: 0.361667 May 30 12:07:29.316937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 80/148] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:28 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1406 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:07:29.544621 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:29.545320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:29.552761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:29.553148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:29.554083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:29.554550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:29.686108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:29.694112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1cea3f10-1601-4b31-a6a6-e2c230635ddb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.153830 May 30 12:07:29.694687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 69/149] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:29 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:29.872303 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-87c53d3c-dfda-4f90-a5d6-4e6397c615c8 req-7f1c78a7-065f-4b38-833a-5f75aec980a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5505ae9e-14bf-49a2-9e34-b42e866bb86f", "tag": "d263c2ea-94ff-4515-becb-13b8808cda29"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:29.881930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-87c53d3c-dfda-4f90-a5d6-4e6397c615c8 req-7f1c78a7-065f-4b38-833a-5f75aec980a8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:29.882458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-87c53d3c-dfda-4f90-a5d6-4e6397c615c8 req-7f1c78a7-065f-4b38-833a-5f75aec980a8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:29.894266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-87c53d3c-dfda-4f90-a5d6-4e6397c615c8 req-7f1c78a7-065f-4b38-833a-5f75aec980a8 service nova] Creating event network-changed:d263c2ea-94ff-4515-becb-13b8808cda29 for instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f on hv-cinder-83979 May 30 12:07:29.900093 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-87c53d3c-dfda-4f90-a5d6-4e6397c615c8 req-7f1c78a7-065f-4b38-833a-5f75aec980a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032036 May 30 12:07:29.900822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 81/150] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:30.335929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:30.337335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:30.344232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.344678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.345465 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.346444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.497068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.508681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.510296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:30.511603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-84a532ee-f84b-4944-b62c-144805f4db7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1598 microversion: 2.20 time: 0.181284 May 30 12:07:30.512193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 70/151] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:07:30 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1598 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:07:30.531950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:30.532625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:30.542374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.543641 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.544658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.545276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.677951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-af59f53c-56cb-4bb3-a40c-9d7dee6677fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.151602 May 30 12:07:30.679056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 82/152] 10.222.0.41 () {60 vars in 1315 bytes} [Mon May 30 12:07:30 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:07:30.711523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:30.712166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:30.722630 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.723085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:30.723901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:30.724349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:31.018146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:31.027294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b29bcfca-52f9-4ff8-bf48-e415d2177fac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.319512 May 30 12:07:31.028288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 71/153] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:30 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:32.044492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:32.045100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:32.055492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:32.056091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:32.057123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:32.057740 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:32.222139 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-7decbfd2-57c3-41eb-b034-128a130b0bc6 req-8850a962-3b54-4994-a902-746d79187552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:32.234983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-7decbfd2-57c3-41eb-b034-128a130b0bc6 req-8850a962-3b54-4994-a902-746d79187552 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:32.235434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-7decbfd2-57c3-41eb-b034-128a130b0bc6 req-8850a962-3b54-4994-a902-746d79187552 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:32.262292 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-7decbfd2-57c3-41eb-b034-128a130b0bc6 req-8850a962-3b54-4994-a902-746d79187552 service nova] Creating event network-changed:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:07:32.270343 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-7decbfd2-57c3-41eb-b034-128a130b0bc6 req-8850a962-3b54-4994-a902-746d79187552 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052975 May 30 12:07:32.271608 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 72/154] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:07:32.273815 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:32.281730 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4e088e90-20d1-478c-8c89-9f8d4b491f93 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.241275 May 30 12:07:32.282802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 83/155] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:32 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:33.301900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:33.303404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:33.312209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:33.313245 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:33.314239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:33.314894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:33.480407 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:33.493333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ac4d9c21-3083-4ae2-88b0-33e5843cc74a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.197816 May 30 12:07:33.494080 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 73/156] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:33 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:34.510354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:34.511561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:34.513610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=92 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:34.519063 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.519507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.520502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:34.520941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:34.683696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:34.693200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c1b77a95-caee-4787-9de1-de05f8d55be1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.186581 May 30 12:07:34.700221 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 84/157] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:34 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:35.709987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:35.710604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:35.713025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=88 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:35.718562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.719161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.719807 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:35.720268 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:35.869517 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:35.877568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-698c53e6-65cb-4515-9497-929edf2b4d0d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.170852 May 30 12:07:35.878258 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 74/158] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:35 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:36.895894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:36.896520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:36.904214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.904841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:36.905620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:36.906058 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:37.070924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:37.080651 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-77914e0b-ee0a-40f7-8ad5-ebbbdf4a3f0c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.188143 May 30 12:07:37.081752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 85/159] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:36 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:38.099425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:38.100203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:38.110035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:38.110586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:38.111716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:38.112186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:38.259792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:38.268038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4b039beb-11f5-4a3d-a947-f22862204772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.173195 May 30 12:07:38.269209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 75/160] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:38 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:39.285497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:39.286158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:39.292617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:39.293069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:39.293837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:39.294276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:39.436195 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:39.444084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e736f5f2-9680-42a3-bcfe-7d8702069440 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.163030 May 30 12:07:39.444650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 86/161] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:39 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:40.460629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:40.461183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:40.467731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.468225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.469000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:40.469438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:40.624742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:40.633028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a73ce2f2-3f3d-4cba-abd7-528735d8933b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1364 microversion: 2.1 time: 0.177126 May 30 12:07:40.633683 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 76/162] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:40 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:41.649943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:41.650646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:41.657779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.658313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.659205 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.659712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.808705 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:41.817534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b5a3f61b-45db-4c3e-a1c6-236727e7de80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1550 microversion: 2.1 time: 0.171414 May 30 12:07:41.818182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 87/163] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:41 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1550 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:41.834432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:41.834930 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:41.841876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.842743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.843028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:41.843464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:41.937416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1533d8be-982f-413e-a088-c7ce35a4e1e3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106972 May 30 12:07:41.938204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 77/164] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:07:41 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:43.130829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-315942c0-672f-45ba-86fc-91ca5014b288 req-ca540d8a-cab3-4613-82fc-ee1ee755a23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74de07ed-a2fe-45f8-ac09-ec21741046db", "tag": "025b3ade-423e-4cd4-ba87-23078118b6b9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:43.143037 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-315942c0-672f-45ba-86fc-91ca5014b288 req-ca540d8a-cab3-4613-82fc-ee1ee755a23b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:43.145309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-315942c0-672f-45ba-86fc-91ca5014b288 req-ca540d8a-cab3-4613-82fc-ee1ee755a23b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:43.180643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-315942c0-672f-45ba-86fc-91ca5014b288 req-ca540d8a-cab3-4613-82fc-ee1ee755a23b service nova] Creating event network-changed:025b3ade-423e-4cd4-ba87-23078118b6b9 for instance 74de07ed-a2fe-45f8-ac09-ec21741046db on hv-cinder-83979 May 30 12:07:43.194241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-315942c0-672f-45ba-86fc-91ca5014b288 req-ca540d8a-cab3-4613-82fc-ee1ee755a23b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062579 May 30 12:07:43.195012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 88/165] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:51.702102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:51.702666 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:51.709129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.709586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.710357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.710795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.738192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:07:51.847096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a5f37c0c-d5d9-44fd-9e75-f4beeff46adc tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 204 len: 0 microversion: 2.1 time: 0.149321 May 30 12:07:51.847675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 78/166] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:07:51 2022] DELETE /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:07:51.856744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:51.857442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:51.864077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.864628 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:51.865398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:51.866004 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:52.046533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:52.056825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c1df5879-2282-4ce5-b853-c055513036ae tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.204286 May 30 12:07:52.058003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 89/167] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:51 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:53.074899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:53.075902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:53.083914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:53.084362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:53.085179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:53.085556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:53.222790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:53.230955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-88834a07-6a7c-497a-bcb9-7ae763eefa03 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.160151 May 30 12:07:53.231536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 79/168] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:53 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:54.248488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:54.249154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:54.256757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.262503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.263317 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:54.263977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:54.415003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:54.425212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-aee744b1-ec48-4945-866c-59b9531911c6 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.180984 May 30 12:07:54.425775 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 90/169] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:54 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:55.446017 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:55.446752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:55.453006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.453459 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.454225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:55.454695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:55.459503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:55.598870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:55.606960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5ebe3834-2691-400b-9c5a-5a0c34e44366 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.168214 May 30 12:07:55.607554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 80/170] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:55 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:56.632488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:56.633645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:56.639895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.640533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.641297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:56.641893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:56.788209 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:56.796260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5580b5d5-22bd-48b8-a1ed-4d597032d754 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.167693 May 30 12:07:56.796829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 91/171] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:56 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:57.814853 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:57.815575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:57.825411 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.825823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:57.826804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:57.827564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:58.016067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:58.028397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7a0b1b7b-126e-4604-8071-3e3e774aaeaa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1554 microversion: 2.1 time: 0.218474 May 30 12:07:58.029030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 81/172] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:57 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1554 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:07:58.774671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-a6d97cde-c0b5-41bd-a2fa-a5e792f18b5a req-aceb593c-cfc7-4f73-a48d-6dea50f34728 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87172ed-2fce-4938-beb7-5ef69157c3e5", "name": "network-vif-deleted", "tag": "630a855c-7b0d-4661-be0f-d5b31ffd1801"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:07:58.787432 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a6d97cde-c0b5-41bd-a2fa-a5e792f18b5a req-aceb593c-cfc7-4f73-a48d-6dea50f34728 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:58.789954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a6d97cde-c0b5-41bd-a2fa-a5e792f18b5a req-aceb593c-cfc7-4f73-a48d-6dea50f34728 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:58.794586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=69 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:07:58.812686 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-a6d97cde-c0b5-41bd-a2fa-a5e792f18b5a req-aceb593c-cfc7-4f73-a48d-6dea50f34728 service nova] Creating event network-vif-deleted:630a855c-7b0d-4661-be0f-d5b31ffd1801 for instance b87172ed-2fce-4938-beb7-5ef69157c3e5 on hv-cinder-83979 May 30 12:07:58.821692 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-a6d97cde-c0b5-41bd-a2fa-a5e792f18b5a req-aceb593c-cfc7-4f73-a48d-6dea50f34728 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051169 May 30 12:07:58.823768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 92/173] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:07:59.047542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:07:59.048218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:07:59.060583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:59.062043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:59.063042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:07:59.063696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:07:59.134673 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:07:59.146436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fb36f489-5220-4222-ac6e-d5cb821f4144 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1345 microversion: 2.1 time: 0.103764 May 30 12:07:59.147013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 82/174] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:07:59 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1345 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:00.164011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:00.164725 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:00.180139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:00.180734 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:00.181757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:00.182289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:00.221601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:00.222255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:00.223197 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lazy-loading 'fault' on Instance uuid b87172ed-2fce-4938-beb7-5ef69157c3e5 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:00.289502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec4a4f7736964e5ca31d0ac8f63ffd19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2288722145134e6b9b93fb4075f0a291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:00.304348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-169da860-562e-459c-82c1-1ee3f00ce649 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 200 len: 1304 microversion: 2.1 time: 0.143231 May 30 12:08:00.304348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 93/175] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:00 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:01.318397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:01.319008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:01.326104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.326731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.327936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.328369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.342159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] HTTP exception thrown: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Request method failure captured: May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 HTTP/1.1 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNM8DoNdStOaffmj-s8GYj55DJkbNNJiTKpTz0GZMLEatNdrBctPrKY6QIftXWFgM-GZKVL2wIuuTrX_nY_L8VIxsMWzb8PmzJHUql0mmx_w-6sdtgO4P2Wj_kPlj-EXAVBNWtOUacQXCL1OPGF_q5W8h3NJfUsbI7oP0xji_RgntM May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:08:01.346760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_2288722145134e6b9b93fb4075f0a291", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: ec4a4f7736964e5ca31d0ac8f63ffd19 May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.348540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'b87172ed-2fce-4938-beb7-5ef69157c3e5'} May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:01.349315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.350402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:01.352098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Returning 404 to user: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:01.352298 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-07ffde2f-a2af-40e1-8125-4a073f449a08 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 404 len: 111 microversion: 2.1 time: 0.037787 May 30 12:08:01.353090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 83/176] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:01 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:01.466089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:01.467164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:01.474027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.474903 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.475676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:01.476130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:01.494361 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] HTTP exception thrown: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Request method failure captured: May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5/os-volume_attachments HTTP/1.1 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNM8DoNdStOaffmj-s8GYj55DJkbNNJiTKpTz0GZMLEatNdrBctPrKY6QIftXWFgM-GZKVL2wIuuTrX_nY_L8VIxsMWzb8PmzJHUql0mmx_w-6sdtgO4P2Wj_kPlj-EXAVBNWtOUacQXCL1OPGF_q5W8h3NJfUsbI7oP0xji_RgntM May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:08:01.499439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_2288722145134e6b9b93fb4075f0a291", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: ec4a4f7736964e5ca31d0ac8f63ffd19 May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.501188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'server_id': 'b87172ed-2fce-4938-beb7-5ef69157c3e5'} May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:01.502268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:01.503755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:01.505463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Returning 404 to user: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:01.505463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-90e0d64b-490e-4342-b50f-d270980796f8 tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039021 May 30 12:08:01.505463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 94/177] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:08:01 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:02.731623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:02.731623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.740864 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.741317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.742143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.742634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.761527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] HTTP exception thrown: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Request method failure captured: May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 HTTP/1.1 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNM8DoNdStOaffmj-s8GYj55DJkbNNJiTKpTz0GZMLEatNdrBctPrKY6QIftXWFgM-GZKVL2wIuuTrX_nY_L8VIxsMWzb8PmzJHUql0mmx_w-6sdtgO4P2Wj_kPlj-EXAVBNWtOUacQXCL1OPGF_q5W8h3NJfUsbI7oP0xji_RgntM May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:08:02.763478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_2288722145134e6b9b93fb4075f0a291", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: ec4a4f7736964e5ca31d0ac8f63ffd19 May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.764787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'b87172ed-2fce-4938-beb7-5ef69157c3e5'} May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:02.765497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.766768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:02.767886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Returning 404 to user: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:02.767886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5adc7358-6fd3-4cf9-86e0-ea1d11f078ee tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "DELETE /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 404 len: 111 microversion: 2.1 time: 0.039665 May 30 12:08:02.767886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 84/178] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:08:02 2022] DELETE /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:02.781796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:02.781796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] [instance: b87172ed-2fce-4938-beb7-5ef69157c3e5] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:02.804752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.805319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.806707 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:02.807961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:02.824095 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] HTTP exception thrown: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Request method failure captured: May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 HTTP/1.1 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNM8DoNdStOaffmj-s8GYj55DJkbNNJiTKpTz0GZMLEatNdrBctPrKY6QIftXWFgM-GZKVL2wIuuTrX_nY_L8VIxsMWzb8PmzJHUql0mmx_w-6sdtgO4P2Wj_kPlj-EXAVBNWtOUacQXCL1OPGF_q5W8h3NJfUsbI7oP0xji_RgntM May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:08:02.827430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_2288722145134e6b9b93fb4075f0a291", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/2288722145134e6b9b93fb4075f0a291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 2288722145134e6b9b93fb4075f0a291 May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-DeleteServersTestJSON-1748630375 May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: ec4a4f7736964e5ca31d0ac8f63ffd19 May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-DeleteServersTestJSON-1748630375-project May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.828591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'b87172ed-2fce-4938-beb7-5ef69157c3e5'} May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:02.829239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. May 30 12:08:02.830277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:02.831228 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] Returning 404 to user: Instance b87172ed-2fce-4938-beb7-5ef69157c3e5 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:02.831228 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-33de06a6-c066-4f96-a4cd-2ca73b7d9efa tempest-DeleteServersTestJSON-1748630375 tempest-DeleteServersTestJSON-1748630375-project] 10.222.0.41 "GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5" status: 404 len: 111 microversion: 2.1 time: 0.053159 May 30 12:08:02.833513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 95/179] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:02 2022] GET /compute/v2.1/servers/b87172ed-2fce-4938-beb7-5ef69157c3e5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:06.753428 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1072488901", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "networks": [{"uuid": "5a2175c0-2031-4e38-95a6-32cd00d28f7c"}]}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:06.784752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:06.848017 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] validate_networks() for [('5a2175c0-2031-4e38-95a6-32cd00d28f7c', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:07.712223 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:07.712662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:07.713135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:07.713542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:07.713952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:07.723802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.724310 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.725309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:07.725749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:07.745905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Getting quotas for project 0fa1cd28ccbd46a2925b432e3ff62c3f. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:07.750470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Getting quotas for user b6c7d188b2764872b2bd3245e1a7ab1a and project 0fa1cd28ccbd46a2925b432e3ff62c3f. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:07.763580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:07.766180 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:07.823445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0f66db6a-2821-45a0-8c3b-8143e589a1db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080302 May 30 12:08:07.824133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 85/180] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:08:07.835185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2809a5c3-492e-46c3-b580-a3c1a7a5ba84 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:07.835931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2809a5c3-492e-46c3-b580-a3c1a7a5ba84 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:07.852585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=26 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:07.926862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2809a5c3-492e-46c3-b580-a3c1a7a5ba84 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:07.934501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2809a5c3-492e-46c3-b580-a3c1a7a5ba84 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1214 microversion: 2.1 time: 0.104257 May 30 12:08:07.936474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 96/181] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:07 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:08.954032 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:08.954767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:08.967991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.968714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:08.969665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:08.970215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:09.068654 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:09.077539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8fbf653a-2101-435e-afdb-a21275f93ce7 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1266 microversion: 2.1 time: 0.128034 May 30 12:08:09.078720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 86/182] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:08 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:10.095598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:10.096152 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:10.102965 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:10.103414 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:10.104367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:10.104644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:10.184536 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:10.195931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-af41edb5-dfcb-467e-9896-6b2d9ae44f00 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1272 microversion: 2.1 time: 0.104026 May 30 12:08:10.197254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 97/183] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:10 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1272 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:11.103025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-467003344", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:11.154673 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] validate_networks() for [('2b5e847e-ae7c-425e-b52a-485f1649ea1d', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:11.216206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:11.216935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:11.226576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.227474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.229253 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.229859 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.317948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:11.326024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0818f576-66f6-4f26-a013-e9725efdf9a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1272 microversion: 2.1 time: 0.116755 May 30 12:08:11.326712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 98/184] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:11 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1272 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:11.609416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:11.610441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:11.611186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:11.611935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:11.612529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:11.622615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.623150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.623850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:11.624564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:11.648812 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:11.653398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for user 4e875190d9dc48edb929bb316d5e576e and project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:11.666474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:11.668770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:11.716896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1533dee5-9200-4af1-baa3-51ab8dd15a73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.740944 May 30 12:08:11.723329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 87/185] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:08:11.730992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e35ae1c8-2c18-45aa-a72c-b7f695ddb9ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:11.741976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e35ae1c8-2c18-45aa-a72c-b7f695ddb9ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:11.863105 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e35ae1c8-2c18-45aa-a72c-b7f695ddb9ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:11.887041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e35ae1c8-2c18-45aa-a72c-b7f695ddb9ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1221 microversion: 2.1 time: 0.159548 May 30 12:08:11.887877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 99/186] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:11 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1221 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:11.949580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1620403763", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:12.013031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] validate_networks() for [('2b5e847e-ae7c-425e-b52a-485f1649ea1d', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:12.343767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:12.344729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:12.353604 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.354373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.356678 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.357337 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.464585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:12.465701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:12.466528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:12.467136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:12.467924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:12.487560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.488425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.489227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:12.489661 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:12.514527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:12.518592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for user 4e875190d9dc48edb929bb316d5e576e and project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:12.530835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:12.533730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:12.586937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:12.594737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-30e26f97-6323-4e4b-bd79-a677d74f9dc9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.254932 May 30 12:08:12.595317 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 100/187] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:12 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:12.599796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1f44223a-a5db-4fa5-8918-decd94ad361d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.655490 May 30 12:08:12.600652 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 88/188] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:08:12.611929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-84f27b7d-0591-4da5-ad18-9cfe3dfa132b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:12.612825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-84f27b7d-0591-4da5-ad18-9cfe3dfa132b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:12.696314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-84f27b7d-0591-4da5-ad18-9cfe3dfa132b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:12.703959 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-84f27b7d-0591-4da5-ad18-9cfe3dfa132b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1222 microversion: 2.1 time: 0.096695 May 30 12:08:12.707595 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 101/189] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:12 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:13.272574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-ae316c68-b8b1-4948-a757-1784efe35993 req-70f3884c-9d51-4f87-9d02-a3f9a0346ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b1b45eb-7388-40a1-8f20-4999b087238f", "tag": "75c30eb7-477b-425b-b7ba-ce388a7dc797"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:13.287793 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ae316c68-b8b1-4948-a757-1784efe35993 req-70f3884c-9d51-4f87-9d02-a3f9a0346ed8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.288615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ae316c68-b8b1-4948-a757-1784efe35993 req-70f3884c-9d51-4f87-9d02-a3f9a0346ed8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.303676 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-ae316c68-b8b1-4948-a757-1784efe35993 req-70f3884c-9d51-4f87-9d02-a3f9a0346ed8 service nova] Creating event network-changed:75c30eb7-477b-425b-b7ba-ce388a7dc797 for instance 0b1b45eb-7388-40a1-8f20-4999b087238f on hv-cinder-83979 May 30 12:08:13.309571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-ae316c68-b8b1-4948-a757-1784efe35993 req-70f3884c-9d51-4f87-9d02-a3f9a0346ed8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041446 May 30 12:08:13.311122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 89/190] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:13.612579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:13.613769 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:13.627982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.629126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.633140 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.633843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.722516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:13.724280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:13.732973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.733983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.734905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:13.735481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:13.821064 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:13.828980 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-63038333-183f-46a7-9962-edbdb527a149 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1218 microversion: 2.1 time: 0.111680 May 30 12:08:13.830866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 90/191] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:13 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:14.101345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:14.110473 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-810eeb1e-e42e-4902-a091-96920b50a5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.502279 May 30 12:08:14.111062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 102/192] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:13 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:14.848568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:14.850088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:14.858583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:14.859036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:14.859858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:14.860273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:14.951158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:14.976327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4450ab0a-d4f9-4444-a4df-cc55f6002b62 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1280 microversion: 2.1 time: 0.132527 May 30 12:08:14.977168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 91/193] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:14 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1280 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:15.156606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:15.157325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:15.183955 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.187910 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.190279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:15.191501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:15.485008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:15.493019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d19ef24a-4323-4477-ac88-e0ac85b44667 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.362564 May 30 12:08:15.493909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 103/194] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:15 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:15.994156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:15.994766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:16.001155 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.001601 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.002356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.002787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.138614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:16.146338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3510c2b4-caa7-4185-9112-54cd47aa699d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.156102 May 30 12:08:16.146908 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 92/195] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:15 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:16.510516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:16.511070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:16.518649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.519379 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.520173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:16.520671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:16.986315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:16.996160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1922c65a-386e-4b14-b4ed-0a7804d7bd3d tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.489911 May 30 12:08:16.997228 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 104/196] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:16 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:17.162850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:17.163469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:17.171086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:17.171619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.172644 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:17.173328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.312245 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:17.321113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7e8c22a7-5b0e-4c8e-b612-368ff01af692 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.162437 May 30 12:08:17.321791 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 93/197] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:17 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:17.831639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-8105a18c-322a-40c1-b4dc-d849be9c6842 req-10081f3a-569d-4b94-bd95-0c68cdf66c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cbe4311-a6a8-45e5-9074-875b07bf7166", "tag": "75435eb2-71bc-4e5e-bea5-27ad5c995b1d"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:17.852133 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-8105a18c-322a-40c1-b4dc-d849be9c6842 req-10081f3a-569d-4b94-bd95-0c68cdf66c3f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:17.852623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-8105a18c-322a-40c1-b4dc-d849be9c6842 req-10081f3a-569d-4b94-bd95-0c68cdf66c3f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:17.868918 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-8105a18c-322a-40c1-b4dc-d849be9c6842 req-10081f3a-569d-4b94-bd95-0c68cdf66c3f service nova] Creating event network-changed:75435eb2-71bc-4e5e-bea5-27ad5c995b1d for instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 on hv-cinder-83979 May 30 12:08:17.876509 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-8105a18c-322a-40c1-b4dc-d849be9c6842 req-10081f3a-569d-4b94-bd95-0c68cdf66c3f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049647 May 30 12:08:17.877619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 105/198] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:18.015349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:18.015996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:18.033947 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.034405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.036202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.036645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.221810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:18.232271 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-58d644dd-7a0c-4586-bbd0-162a62ebcb47 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.221927 May 30 12:08:18.233576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 94/199] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:18 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:18.340121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:18.341393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:18.349554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.350006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.350973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.351469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.380424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-2082caba-818c-49e4-baa1-16c4c9ab3d17 req-a404e2b8-1cc9-44b7-89e5-2a4735df44db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1b45eb-7388-40a1-8f20-4999b087238f", "name": "network-vif-plugged", "status": "completed", "tag": "75c30eb7-477b-425b-b7ba-ce388a7dc797"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:18.393786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2082caba-818c-49e4-baa1-16c4c9ab3d17 req-a404e2b8-1cc9-44b7-89e5-2a4735df44db service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:18.395538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2082caba-818c-49e4-baa1-16c4c9ab3d17 req-a404e2b8-1cc9-44b7-89e5-2a4735df44db service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:18.428544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-2082caba-818c-49e4-baa1-16c4c9ab3d17 req-a404e2b8-1cc9-44b7-89e5-2a4735df44db service nova] Creating event network-vif-plugged:75c30eb7-477b-425b-b7ba-ce388a7dc797 for instance 0b1b45eb-7388-40a1-8f20-4999b087238f on hv-cinder-83979 May 30 12:08:18.443862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-2082caba-818c-49e4-baa1-16c4c9ab3d17 req-a404e2b8-1cc9-44b7-89e5-2a4735df44db service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068520 May 30 12:08:18.448213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 95/200] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:18.825225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:18.833336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3431f19e-ea07-4cbd-9086-ad0a429042d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.498285 May 30 12:08:18.834960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 106/201] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:18 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:19.251547 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:19.252267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:19.259085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.259531 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.260323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.260769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.393104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:19.400649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9033df6b-342a-494e-925d-3dca9c8d9fb4 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.153858 May 30 12:08:19.401217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 96/202] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:19 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:19.850373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:19.850983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:19.857023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.857470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.858484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.858916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.910851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-531da01c-774a-4675-b8c5-805c7da20e82 req-d52b3981-801e-43a0-9a81-6c450495e7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2484e75-927b-450d-9638-6e57fc7f7e32", "tag": "f625410d-dd8f-48af-bb65-d7cac1e77379"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:19.922667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-531da01c-774a-4675-b8c5-805c7da20e82 req-d52b3981-801e-43a0-9a81-6c450495e7ce service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:19.923447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-531da01c-774a-4675-b8c5-805c7da20e82 req-d52b3981-801e-43a0-9a81-6c450495e7ce service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:19.935947 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-531da01c-774a-4675-b8c5-805c7da20e82 req-d52b3981-801e-43a0-9a81-6c450495e7ce service nova] Creating event network-changed:f625410d-dd8f-48af-bb65-d7cac1e77379 for instance d2484e75-927b-450d-9638-6e57fc7f7e32 on hv-cinder-83979 May 30 12:08:19.941527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-531da01c-774a-4675-b8c5-805c7da20e82 req-d52b3981-801e-43a0-9a81-6c450495e7ce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 May 30 12:08:19.942137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 97/203] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:20.022548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:20.032176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-96b28c4c-f110-4ea3-affe-58a02aaa0b4c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.186185 May 30 12:08:20.032751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 107/204] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:19 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:20.418987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:20.419691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:20.426745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.427189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:20.427988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:20.428430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:20.568034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:20.575691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ff84877c-a6c1-4cd9-9705-eb9886a6a700 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.161392 May 30 12:08:20.576451 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 98/205] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:20 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:21.051653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:21.052228 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:21.058479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.058931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.059699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.060169 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.194435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:21.204641 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8ec5256d-4455-445b-a3bf-676d79e43d1e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.157594 May 30 12:08:21.206967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 108/206] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:21 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:21.593399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:21.594010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:21.607419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.607907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.608947 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:21.609724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:21.752165 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:21.760821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d8537676-586d-498a-b773-deb8c5678e1a tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.171614 May 30 12:08:21.761391 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 99/207] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:21 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:22.225038 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:22.225857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:22.233396 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.233969 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.234754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.235184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.383702 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:22.391094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6c9321c6-a4b4-4ad1-8c38-745f46fca518 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.171276 May 30 12:08:22.391667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 109/208] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:22 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:22.779244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:22.780040 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:22.783147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=6 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:22.783803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=18 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:22.789798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.790254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:22.791048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:22.791482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.021236 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:23.029345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8bbfb6c5-edeb-4d3a-9eab-90798437b9b0 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1314 microversion: 2.1 time: 0.254725 May 30 12:08:23.029926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 100/209] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:22 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:23.407901 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:23.408527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:23.412068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:23.416563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.417035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.417836 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:23.418271 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:23.680158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:23.688327 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-385dc551-8b8e-499d-8ce4-3be446b7bd33 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.284135 May 30 12:08:23.689699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 110/210] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:23 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:24.046663 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.047416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.054240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.054692 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.055458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.055924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.191808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:24.199858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b299cbfe-9923-4e54-9528-8a7e183e7a96 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1498 microversion: 2.1 time: 0.157247 May 30 12:08:24.200430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 101/211] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:24 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:24.547351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-7099d7ee-d4b1-4503-bc16-3af30dcab08a req-4a8de765-d2d0-43ea-8dfc-287da920f599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbe4311-a6a8-45e5-9074-875b07bf7166", "name": "network-vif-plugged", "status": "completed", "tag": "75435eb2-71bc-4e5e-bea5-27ad5c995b1d"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:24.575041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-7099d7ee-d4b1-4503-bc16-3af30dcab08a req-4a8de765-d2d0-43ea-8dfc-287da920f599 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.576272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-7099d7ee-d4b1-4503-bc16-3af30dcab08a req-4a8de765-d2d0-43ea-8dfc-287da920f599 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.614164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-7099d7ee-d4b1-4503-bc16-3af30dcab08a req-4a8de765-d2d0-43ea-8dfc-287da920f599 service nova] Creating event network-vif-plugged:75435eb2-71bc-4e5e-bea5-27ad5c995b1d for instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 on hv-cinder-83979 May 30 12:08:24.624222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-7099d7ee-d4b1-4503-bc16-3af30dcab08a req-4a8de765-d2d0-43ea-8dfc-287da920f599 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080743 May 30 12:08:24.626441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 111/212] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:24.706803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.707565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.713578 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.714035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.714800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.715231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.720069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:24.891593 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:24.899354 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-35efe4f5-6b22-443d-893c-4f9ae77720e3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.196720 May 30 12:08:24.900256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 102/213] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:24 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:24.938251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:24.938868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:24.947002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.947460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.948396 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:24.948721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:24.997149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:25.103075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a3b0f4ef-c839-465b-9e3f-094d90983680 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 204 len: 0 microversion: 2.1 time: 0.168737 May 30 12:08:25.103672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 112/214] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:08:24 2022] DELETE /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:25.112175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.113325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.120296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.120951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.121877 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.122454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.310994 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:25.319297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-23181eb8-1ede-4b7a-ae70-32a8035e75db tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.211313 May 30 12:08:25.320111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 103/215] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:25.688001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.689013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.696158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.696737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.697663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.698217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.702151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:25.727704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d8fac304-e3b0-473d-be37-936b675696e2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/ips" status: 200 len: 150 microversion: 2.1 time: 0.047955 May 30 12:08:25.728322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 113/216] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:25.918429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:25.919047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:25.926434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.927124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:25.928291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:25.928883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.087657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:26.096069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b1d5385c-ba43-4159-8b28-ed2240e7144f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.182271 May 30 12:08:26.106526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 104/217] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:25 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:26.335646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:26.336493 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:26.343296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.343573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.344383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:26.344822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:26.528021 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:26.542139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a44ec9c6-6398-4d6e-98f7-3ec075693fdd tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.210490 May 30 12:08:26.552281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 114/218] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:26 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:27.114106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:27.115444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.125549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.126262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.127379 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.127783 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.194624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9cb29d-20c0-45ea-9cac-ac7e34f2a243"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:27.195690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.205605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.206925 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.208436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.209216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.282302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:27.290678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e4c5fb74-c1da-43cd-96d9-5c64f434be32 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.181597 May 30 12:08:27.291404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 105/219] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:27 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:27.558683 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:27.559379 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.565332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.566511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.567363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.567708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.698860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:27.707509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-47b9ce98-34a6-4bd3-a51a-4673d8f8ff78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.151459 May 30 12:08:27.708114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 106/220] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:27 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:27.941720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:27.942218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:27.948353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.948806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.949570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:27.950007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:27.977111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-50ca328d-3dc4-40ba-a244-e1455db25047 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/ips" status: 200 len: 152 microversion: 2.20 time: 0.039425 May 30 12:08:27.977696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 107/221] 10.222.0.41 () {60 vars in 1288 bytes} [Mon May 30 12:08:27 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:08:28.312303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.312941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.321135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.321745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.322766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.323226 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.463395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.470854 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e05e7dd6-0836-40a8-a3d9-d0950d923ef5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1322 microversion: 2.1 time: 0.166695 May 30 12:08:28.471473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 108/222] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:28 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:28.724800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:28.725646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:28.732494 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.733318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.734227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.735010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.895131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:28.900235 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b9f2c9bf-effd-436b-aee4-4aaf7ada9a0d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.709928 May 30 12:08:28.901453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 115/223] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:08:27 2022] POST /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments => generated 194 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:28.902628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3ce94bdd-7e9f-4c87-bd49-c099a7ae5d52 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.182795 May 30 12:08:28.903187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 109/224] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:28 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:28.907266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-e4c63abb-fce2-4e95-8a78-f82328eb8abe req-2fcb5e6a-2512-4146-bb04-c0d0b3457628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2484e75-927b-450d-9638-6e57fc7f7e32", "name": "network-vif-plugged", "status": "completed", "tag": "f625410d-dd8f-48af-bb65-d7cac1e77379"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:28.916744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-e4c63abb-fce2-4e95-8a78-f82328eb8abe req-2fcb5e6a-2512-4146-bb04-c0d0b3457628 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:28.917260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-e4c63abb-fce2-4e95-8a78-f82328eb8abe req-2fcb5e6a-2512-4146-bb04-c0d0b3457628 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:28.928586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-e4c63abb-fce2-4e95-8a78-f82328eb8abe req-2fcb5e6a-2512-4146-bb04-c0d0b3457628 service nova] Creating event network-vif-plugged:f625410d-dd8f-48af-bb65-d7cac1e77379 for instance d2484e75-927b-450d-9638-6e57fc7f7e32 on hv-cinder-83979 May 30 12:08:28.933337 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-e4c63abb-fce2-4e95-8a78-f82328eb8abe req-2fcb5e6a-2512-4146-bb04-c0d0b3457628 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030439 May 30 12:08:28.933923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 116/225] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:29.488445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:29.489078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.495543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.496043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.496811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.497253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.631832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.639342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4e95e89b-d4d8-47ae-915e-b8cc11f9325b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1515 microversion: 2.1 time: 0.154812 May 30 12:08:29.639932 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 110/226] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:29 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:29.656960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:29.657977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.664686 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.665141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.666019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.666459 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.689295 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'flavor' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:29.800160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7866eadd-66aa-4f64-ac6d-fdd74728bf1f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166/action" status: 200 len: 32 microversion: 2.1 time: 0.147811 May 30 12:08:29.800857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 117/227] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:08:29 2022] POST /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:08:29.809694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:29.810306 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.816849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.817314 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.818134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.818573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.919928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:29.920754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:29.926992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.927446 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.928246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:29.928688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:29.948584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:29.956730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4d8a55da-6fff-4bb1-9998-ec13b855cf72 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.150770 May 30 12:08:29.958100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 111/228] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:29 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:30.058784 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:30.067102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5388449f-7026-4038-a589-a93ae7ee3fc1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.151334 May 30 12:08:30.067649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 118/229] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:29 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:30.975803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:30.976434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:30.982848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.983534 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:30.984320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:30.984751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:31.084855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:31.085474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:31.092682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:31.093268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:31.094256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:31.094868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:31.122779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:31.130393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-af4f0d15-8061-426d-a539-09d69ed0a0a1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.159601 May 30 12:08:31.130970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 112/230] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:30 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:31.232493 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:31.240573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bc095c7a-dfb7-46fd-bc59-be312b897f92 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.160120 May 30 12:08:31.241161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 119/231] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:31 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:32.147623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:32.148264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:32.154731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.155178 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.155991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.156429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.258155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:32.258975 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:32.267044 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.267523 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.268334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.268767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.291435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:32.299012 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-46a71d02-6f71-4713-aa20-f0a1fafb5bdb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.155826 May 30 12:08:32.299856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 113/232] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:32 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:32.397375 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:32.405122 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c4eb1d20-a7f8-404a-83ad-345827edf382 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1504 microversion: 2.1 time: 0.152067 May 30 12:08:32.405705 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 120/233] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:32 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:32.714185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-bf01d14e-88d9-4328-9579-877a06ceabe4 req-52ba6a9a-26e1-4eb4-8dff-1ee0f451a439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1b45eb-7388-40a1-8f20-4999b087238f", "name": "network-vif-unplugged", "status": "completed", "tag": "75c30eb7-477b-425b-b7ba-ce388a7dc797"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:32.717607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:32.723222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-bf01d14e-88d9-4328-9579-877a06ceabe4 req-52ba6a9a-26e1-4eb4-8dff-1ee0f451a439 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:32.723714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-bf01d14e-88d9-4328-9579-877a06ceabe4 req-52ba6a9a-26e1-4eb4-8dff-1ee0f451a439 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:32.735665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-bf01d14e-88d9-4328-9579-877a06ceabe4 req-52ba6a9a-26e1-4eb4-8dff-1ee0f451a439 service nova] Creating event network-vif-unplugged:75c30eb7-477b-425b-b7ba-ce388a7dc797 for instance 0b1b45eb-7388-40a1-8f20-4999b087238f on hv-cinder-83979 May 30 12:08:32.741149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-bf01d14e-88d9-4328-9579-877a06ceabe4 req-52ba6a9a-26e1-4eb4-8dff-1ee0f451a439 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030695 May 30 12:08:32.741932 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 114/234] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:33.287863 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-90c0217e-ef28-40da-9dae-9fbee1b2379a req-8975396b-c74b-4c64-bba8-fa0bb72ca69b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b1b45eb-7388-40a1-8f20-4999b087238f", "name": "network-vif-deleted", "tag": "75c30eb7-477b-425b-b7ba-ce388a7dc797"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:33.297174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-90c0217e-ef28-40da-9dae-9fbee1b2379a req-8975396b-c74b-4c64-bba8-fa0bb72ca69b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.298278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-90c0217e-ef28-40da-9dae-9fbee1b2379a req-8975396b-c74b-4c64-bba8-fa0bb72ca69b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.313257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-90c0217e-ef28-40da-9dae-9fbee1b2379a req-8975396b-c74b-4c64-bba8-fa0bb72ca69b service nova] Creating event network-vif-deleted:75c30eb7-477b-425b-b7ba-ce388a7dc797 for instance 0b1b45eb-7388-40a1-8f20-4999b087238f on hv-cinder-83979 May 30 12:08:33.319358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:33.319934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-90c0217e-ef28-40da-9dae-9fbee1b2379a req-8975396b-c74b-4c64-bba8-fa0bb72ca69b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039444 May 30 12:08:33.321112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 121/235] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:33.321939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:33.330072 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.330715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.331487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.332499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.423908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:33.425336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:33.433802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.434747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.435546 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.436044 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.478197 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.478883 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.479553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lazy-loading 'fault' on Instance uuid 0b1b45eb-7388-40a1-8f20-4999b087238f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:33.484135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:33.493378 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9bd1e5b9-50b3-4099-8307-2d507fb3d1a8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.181014 May 30 12:08:33.494253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 115/236] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:33 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:33.499466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:33.500103 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:33.506655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.507490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.508483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.509107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.535890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lazy-loading 'flavor' on Instance uuid c9cdf2a8-edd4-4a18-8fa9-443148005b88 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:33.539856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:33.548797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-04b2bafe-6e2c-4820-9580-dacb198a1c18 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1304 microversion: 2.1 time: 0.129450 May 30 12:08:33.549516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 122/237] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:33 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:33.878393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ef82498b-2481-42a0-9604-d229ac874d4b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/action" status: 202 len: 0 microversion: 2.20 time: 0.381799 May 30 12:08:33.882339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 116/238] 10.222.0.41 () {62 vars in 1318 bytes} [Mon May 30 12:08:33 2022] POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:33.887463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:33.888180 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:33.894374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.895461 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:33.896665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:33.897107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.077566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:34.086763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:34.088570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:34.089956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8d906dd8-a740-497e-ab50-ad88fd200ade tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.206231 May 30 12:08:34.090537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 123/239] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:33 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:34.511966 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:34.512705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:34.519038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:34.519623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.520493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:34.520938 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.566890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:34.567631 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:34.575265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:34.575714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.576736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:34.577363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.613003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:34.614126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:34.614572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lazy-loading 'fault' on Instance uuid 0b1b45eb-7388-40a1-8f20-4999b087238f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:08:34.665834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:34.668195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:34.671424 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:34.675486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2039afbe-162b-45c2-8c6c-5612634ae8f3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.168650 May 30 12:08:34.676415 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 117/240] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:34 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:34.680195 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c0e62845-0c91-4a9f-86f1-3a11d9c190cb tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 200 len: 1304 microversion: 2.1 time: 0.117634 May 30 12:08:34.680794 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 124/241] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:34 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:35.109255 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:35.109774 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:35.117431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.117872 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.118648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.119077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.256146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:35.266619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:35.270264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:35.271955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-aa929409-fea0-4b25-9665-5dbc9df9420d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.167075 May 30 12:08:35.272546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 118/242] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:35 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:35.693252 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:35.693823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:35.698146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:35.698886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 0b1b45eb-7388-40a1-8f20-4999b087238f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:35.700490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.700945 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.701711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.702150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.705588 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.706033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.706975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:35.707611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:35.720955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] HTTP exception thrown: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Request method failure captured: May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f HTTP/1.1 May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLOkOV0lfNku2z4vbtjtVHyqynTkPr5vJraWz8EAI2DbuA-5zjrWgHElU9vWRPH6H_EjSBZ6_GseEFMfSamqwiu0aWK_CZ1w4zg0lamK6SmWhpLPytskm6syoJhD6SvLHnXLoZYmmhkKQmjjAinQaOlDiO-TaJF-SA7yOyJkq9cXZTw May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 0fa1cd28ccbd46a2925b432e3ff62c3f May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesActionsTest-340550524 May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:08:35.722669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fa1cd28ccbd46a2925b432e3ff62c3f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesActionsTest-340550524 May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 0fa1cd28ccbd46a2925b432e3ff62c3f May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesActionsTest-340550524 May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesActionsTest-340550524-project May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: b6c7d188b2764872b2bd3245e1a7ab1a May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesActionsTest-340550524-project May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. May 30 12:08:35.726691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '0b1b45eb-7388-40a1-8f20-4999b087238f'} May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:35.727443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. May 30 12:08:35.728949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:08:35.730124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Returning 404 to user: Instance 0b1b45eb-7388-40a1-8f20-4999b087238f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:35.730124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-323f63b4-2234-46d8-a636-91e6656ec8e3 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f" status: 404 len: 111 microversion: 2.1 time: 0.029652 May 30 12:08:35.730124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 119/243] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:35 2022] GET /compute/v2.1/servers/0b1b45eb-7388-40a1-8f20-4999b087238f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:35.851584 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:35.859568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-425728507", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "networks": [{"uuid": "5a2175c0-2031-4e38-95a6-32cd00d28f7c"}]}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:35.860548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0735038e-0f5f-4c5e-9330-69fa1a3fc3d6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.171664 May 30 12:08:35.861250 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 125/244] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:35 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:35.914651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] validate_networks() for [('5a2175c0-2031-4e38-95a6-32cd00d28f7c', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:36.260968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:36.261392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:36.261864 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:36.262272 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:36.262778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:36.271597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.272079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.272881 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.273320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.293694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:36.294309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:36.295976 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Getting quotas for project 0fa1cd28ccbd46a2925b432e3ff62c3f. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:36.300007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Getting quotas for user b6c7d188b2764872b2bd3245e1a7ab1a and project 0fa1cd28ccbd46a2925b432e3ff62c3f. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:36.300331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.301340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.302090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.302526 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.312055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:36.314371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:36.366059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b4b0d13d-a893-41e8-86ca-61fbd8bb5076 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510589 May 30 12:08:36.367025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 120/245] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:08:36.383636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-aa1c548b-c9c0-4cbf-acc9-7d4a6dad8ba9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:36.385205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-aa1c548b-c9c0-4cbf-acc9-7d4a6dad8ba9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:36.454887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-aa1c548b-c9c0-4cbf-acc9-7d4a6dad8ba9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.467275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-aa1c548b-c9c0-4cbf-acc9-7d4a6dad8ba9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1213 microversion: 2.1 time: 0.090319 May 30 12:08:36.468214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 121/246] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:36 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:36.471242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.485980 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.488625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:36.490363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9124cf9a-ab60-4bd5-8f57-eace7b89154d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.200037 May 30 12:08:36.491657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 126/247] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:36 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:36.880420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:36.881622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:36.889917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.890566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:36.891703 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:36.892317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.072425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.082640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4cc4357c-07c4-438b-acbe-af3f21cbe34b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.207498 May 30 12:08:37.083324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 122/248] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:36 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:37.484723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:37.485431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:37.491986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.492442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.493209 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.493640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.509580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:37.510748 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:37.512108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:37.518872 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.519924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.521176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:37.521769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:37.564494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.573251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a72b9f89-71f0-4d9c-9d69-be9171d63132 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1265 microversion: 2.1 time: 0.092484 May 30 12:08:37.574144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 127/249] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:37 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1265 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:37.663348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.671738 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.673342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:37.674583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-967c48d3-8095-4c8f-bc40-daedc35ae158 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.169212 May 30 12:08:37.675393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 123/250] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:37 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:38.100080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.100983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.111217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:38.112983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.113435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.114693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.117919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.338057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.345527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ee1cda7d-b59b-478d-95ca-921a311ef6cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.249709 May 30 12:08:38.346103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 128/251] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:38.591167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.591792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.598523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.598904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.599678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.600156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.665038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.672561 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f72534e2-5983-49e7-b432-23009c0ce9c9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1271 microversion: 2.1 time: 0.085363 May 30 12:08:38.673137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 124/252] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:38.694058 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:38.694944 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:38.701574 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.702108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.702876 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:38.703312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:38.861245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.869949 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.871463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:38.872663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-47d46317-3215-4fc3-b88c-acf46de7459c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.183211 May 30 12:08:38.873233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 129/253] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:38 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:39.362409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:39.368365 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1423902185", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:39.374291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:39.382022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.382743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.383629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.384340 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.423880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] validate_networks() for None {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:39.518324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.526124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9b85fc2b-ab9f-49da-a193-4c8f0404b017 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.167449 May 30 12:08:39.526822 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 125/254] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:39 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:39.656549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-e2601d2b-9921-46f9-9c7b-5cb4371d0f2f req-dc93a7b9-5208-4ab6-9c41-e16d18a3c681 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01da7b9e-4547-47d3-80fd-a3732fc2d367", "tag": "1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:39.666950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-e2601d2b-9921-46f9-9c7b-5cb4371d0f2f req-dc93a7b9-5208-4ab6-9c41-e16d18a3c681 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.667392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-e2601d2b-9921-46f9-9c7b-5cb4371d0f2f req-dc93a7b9-5208-4ab6-9c41-e16d18a3c681 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.679219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-e2601d2b-9921-46f9-9c7b-5cb4371d0f2f req-dc93a7b9-5208-4ab6-9c41-e16d18a3c681 service nova] Creating event network-changed:1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c for instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 on hv-cinder-83979 May 30 12:08:39.684132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-e2601d2b-9921-46f9-9c7b-5cb4371d0f2f req-dc93a7b9-5208-4ab6-9c41-e16d18a3c681 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 May 30 12:08:39.684722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 126/255] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:39.690647 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:39.691616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:39.697986 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.698440 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.699216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.699653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.836179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:39.843647 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e3f6347c-3cb6-4ec3-8be7-cbe2d94da632 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.157001 May 30 12:08:39.844240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 127/256] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:39 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:39.864786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:39.865240 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:39.865676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:39.866088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:39.866646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:39.875730 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.876211 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.877007 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.877466 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.890755 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:39.891640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:39.896488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Getting quotas for project d22b1bc83bba4f8e9deafc253449e8ab. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:39.898716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.899282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.900186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:39.900722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:39.900867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Getting quotas for user c6451c3ad6dc4a7b82b25dbfbd100965 and project d22b1bc83bba4f8e9deafc253449e8ab. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:39.912380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:39.914643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:39.961224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e4bb3028-6f48-4181-a12e-81f04fcbc3d7 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.596524 May 30 12:08:39.962001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 130/257] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:08:39.974380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cd7f77bc-7fa9-4536-88d9-24db883841ef tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:39.976160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cd7f77bc-7fa9-4536-88d9-24db883841ef tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:40.049108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.059460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.061740 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.063766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fe1dc8a0-bb82-4e17-9beb-928a78653279 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.176899 May 30 12:08:40.064569 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 128/258] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:39 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:40.310821 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cd7f77bc-7fa9-4536-88d9-24db883841ef tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.319743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cd7f77bc-7fa9-4536-88d9-24db883841ef tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1215 microversion: 2.1 time: 0.350761 May 30 12:08:40.320420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 131/259] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:39 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1215 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:40.543684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:40.544462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:40.552055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.552591 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.553463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.553978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.686145 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:40.693638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8e219899-20f3-4c53-8866-f9e06cbcae06 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.153893 May 30 12:08:40.694214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 129/260] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:40 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:40.861430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:40.862041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:40.869582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.870158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.870788 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:40.871225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:40.998624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.006884 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-01d24268-5f0d-47e0-9e2e-9ed76e339aca tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.149639 May 30 12:08:41.007452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 132/261] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:40 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:41.082511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:41.083059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:41.089156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.089607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.090369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.090805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.220540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.229020 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.230556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.231713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a9504dcd-f4a0-48a1-932a-89ce2bace1e5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.153241 May 30 12:08:41.232315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 130/262] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:41 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:41.336639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:41.337196 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:41.343182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.343629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.344435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.344878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.407363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.415275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-83f62cff-3e32-4972-b07b-8241f2769357 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1267 microversion: 2.1 time: 0.082464 May 30 12:08:41.415864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 133/263] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:41 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:41.710664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:41.711288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:41.717742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.718192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.718953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:41.719392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:41.848358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:41.855204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2a09633b-2546-4690-b76b-18ad695aebff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.148907 May 30 12:08:41.855777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 131/264] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:41 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:42.024137 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:42.024756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:42.031580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.032059 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.032827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.033290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.167614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.174923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-acbc9a6c-4812-4be1-8ba5-bb89f7360385 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.155318 May 30 12:08:42.175690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 134/265] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:42 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:42.251723 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:42.252363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:42.259088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.259540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.260333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.260771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.392248 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.400156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.401667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.402821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-379b2083-a08b-4c4f-b4c6-df13481fbebd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.155062 May 30 12:08:42.403383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 132/266] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:42 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:42.432397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:42.433171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:42.439484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.440091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.441726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.442276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.506358 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:42.513706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7fd81f67-a02f-473f-a7ad-29572a091f39 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1267 microversion: 2.1 time: 0.085296 May 30 12:08:42.514273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 135/267] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:42 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:42.873705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:42.874319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:42.881238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.881691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:42.882466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:42.882902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.024349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.031847 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4151a8c6-cb43-4c9a-b6b7-5323d75b4d18 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.162745 May 30 12:08:43.032625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 133/268] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:42 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:43.192494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:43.193100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:43.200243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.200697 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.201576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.202022 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.340578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.348233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d6453ba4-4491-408b-b725-b95e53d1a319 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.160016 May 30 12:08:43.348809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 136/269] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:43 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:43.420802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:43.421412 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:43.427591 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.428077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.428848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.429565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.530963 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:43.531862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:43.539017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.539506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.540518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:43.541088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:43.569773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.580193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.584470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.588827 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-00697652-827a-43e7-8a92-3beecaa86dcc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.171830 May 30 12:08:43.592664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 134/270] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:43 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:43.610891 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:43.619488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c4810947-87d7-4bb6-9a58-c348a9434731 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1267 microversion: 2.1 time: 0.092753 May 30 12:08:43.620100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 137/271] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:43 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:44.051312 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.051987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.065393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.066384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.068084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.068529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.217396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.225026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-020ac403-f833-48c0-b6ec-5bd9f31c65a5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.178793 May 30 12:08:44.225739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 135/272] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:44.366680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.367302 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.373815 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.374269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.375039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.375484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.508721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.516743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ea97f532-7e60-4f8b-820b-58e345da73b8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.154583 May 30 12:08:44.517648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 138/273] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:44.611410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.612061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.618822 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.619276 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.620082 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.620516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.636810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:44.637585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:44.645274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.646641 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.648384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:44.649326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:44.744670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.755384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-314eaf0c-5150-4430-96db-5463edd7f187 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1273 microversion: 2.1 time: 0.122322 May 30 12:08:44.756798 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 139/274] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1273 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:44.785996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.798957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.802467 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:44.804737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c9e5df67-e987-4eb9-87f3-798445ce48ce tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.197590 May 30 12:08:44.805639 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 136/275] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:44 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:44.923363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-85d7dacd-2cca-42f1-8f64-a2f9cda7ee6b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: .version_select at 0x7f61a25fe9d0>, body: {"keypair": {"name": "tempest-keypair-1513559915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCIUaqAoYZvb/D3mg9p1eVitEUQt9o93NAdIH9EYi4NEKqD4S4Fkpks2yct8oMIow4S8iXd5OoOqzxufVmrFRKYq7SViQmEx74r0/jvMG/8VJxeF3Zvw4gun707EuvNPbA=="}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:44.945300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-85d7dacd-2cca-42f1-8f64-a2f9cda7ee6b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:44.950315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-85d7dacd-2cca-42f1-8f64-a2f9cda7ee6b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:45.011880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-85d7dacd-2cca-42f1-8f64-a2f9cda7ee6b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091547 May 30 12:08:45.012549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 140/276] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:08:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:45.087131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-aea304f0-4b36-4678-bb20-4605c1259cef req-12eb70c1-49d9-4252-8af7-ec37c71746e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01da7b9e-4547-47d3-80fd-a3732fc2d367", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:45.105832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-aea304f0-4b36-4678-bb20-4605c1259cef req-12eb70c1-49d9-4252-8af7-ec37c71746e5 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.106276 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-aea304f0-4b36-4678-bb20-4605c1259cef req-12eb70c1-49d9-4252-8af7-ec37c71746e5 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.134342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-aea304f0-4b36-4678-bb20-4605c1259cef req-12eb70c1-49d9-4252-8af7-ec37c71746e5 service nova] Creating event network-vif-plugged:1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c for instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 on hv-cinder-83979 May 30 12:08:45.150305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-aea304f0-4b36-4678-bb20-4605c1259cef req-12eb70c1-49d9-4252-8af7-ec37c71746e5 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066794 May 30 12:08:45.152479 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 137/277] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:45.245002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:45.245933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:45.255383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.256222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.257225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.257875 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.538572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:45.546333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:45.549900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:45.551567 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-64e9d729-85c7-4326-a39f-76ba99c99768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.311588 May 30 12:08:45.554795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 141/278] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:45 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:45.567578 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.568369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.574363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.574969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.580242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:45.774571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:45.775621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:45.783102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.783557 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.784368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:45.784855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:45.994858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.005185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-db73567d-371a-4f00-a2b6-d2f97dbb1586 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.473897 May 30 12:08:46.006024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 138/279] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:45 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:46.010659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:46.011452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:46.017577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.018027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.018796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.019232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.052652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.060699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c2ef5bab-56ee-4e9f-8fb1-ec9490c1b56f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.291698 May 30 12:08:46.061771 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 142/280] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:45 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:46.225576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.242266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.244614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.246199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0e786497-3937-41bf-bbdf-67957541679e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.238967 May 30 12:08:46.247303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 139/281] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:46 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:46.513033 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-aaa250c2-be8e-4088-b555-43c59aa8b67a req-6a76f5c1-7eda-4cec-9362-7a328443892b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c", "tag": "bd575b1f-86bb-4b14-833d-fece382bc5a6"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:46.527423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-aaa250c2-be8e-4088-b555-43c59aa8b67a req-6a76f5c1-7eda-4cec-9362-7a328443892b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.527905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-aaa250c2-be8e-4088-b555-43c59aa8b67a req-6a76f5c1-7eda-4cec-9362-7a328443892b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.557073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-aaa250c2-be8e-4088-b555-43c59aa8b67a req-6a76f5c1-7eda-4cec-9362-7a328443892b service nova] Creating event network-changed:bd575b1f-86bb-4b14-833d-fece382bc5a6 for instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c on hv-cinder-83979 May 30 12:08:46.562339 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-aaa250c2-be8e-4088-b555-43c59aa8b67a req-6a76f5c1-7eda-4cec-9362-7a328443892b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052833 May 30 12:08:46.563490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 143/282] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:46.569069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:46.569726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:46.573413 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:46.574149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=8 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:46.580343 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.580802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.581622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:46.582061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:46.794039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:46.811884 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7ea07b1f-af50-495e-930b-9d941c6a1eea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.247134 May 30 12:08:46.812559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 140/283] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:46 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:47.028089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.028936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.030460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-515442652", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc42f6ba-36b7-432a-8fd7-6b1f2c279d11"}], "security_groups": [{"name": "tempest-securitygroup--734413598"}], "key_name": "tempest-keypair-1513559915", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:47.037206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.037782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.038666 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.039182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.139129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] validate_networks() for [('bc42f6ba-36b7-432a-8fd7-6b1f2c279d11', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:08:47.172187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.180431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5023fee1-abac-49c5-acf8-a554b89a5b78 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1313 microversion: 2.1 time: 0.161844 May 30 12:08:47.181380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 144/284] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:47.185854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.186615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.193256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.193699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.194458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.194897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.333412 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.340933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2721fbaa-8f4d-46a2-9994-f48d9ed3f1fe tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.158499 May 30 12:08:47.341588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 145/285] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:47.351489 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.352149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.358706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.359155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.359951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.360384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.494068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.503122 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.504747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.505923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8f18caee-669a-401c-8b8b-908427e3c9a2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.158309 May 30 12:08:47.506654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 146/286] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:47.528148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:08:47.528650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:08:47.529102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:08:47.529482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:08:47.529896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:08:47.539856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.540394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.541274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.541767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.559574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:08:47.563715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:08:47.575204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:08:47.577509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:08:47.625045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-80e4b6c8-4319-4aec-9b7a-9663361c7800 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.599280 May 30 12:08:47.625698 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 141/287] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:08:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:08:47.636315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-057c68a3-d58c-49db-874b-aedcac4a9fd0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.636911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-057c68a3-d58c-49db-874b-aedcac4a9fd0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.695057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-057c68a3-d58c-49db-874b-aedcac4a9fd0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.702405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-057c68a3-d58c-49db-874b-aedcac4a9fd0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1241 microversion: 2.1 time: 0.069848 May 30 12:08:47.702972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 147/288] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:47.829278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:47.829898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:47.836499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.836952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.837899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:47.838341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:47.979110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:47.987224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-97791c8f-eeba-4d8d-b9b6-a2d6adfda4dc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.162344 May 30 12:08:47.988423 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 142/289] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:47 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:48.197948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.198565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.205770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.206735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.207483 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.207957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.223702 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:48.268089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.268585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.276301 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.276755 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.277518 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.277959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.306177 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-32a4801f-d780-436c-9123-bc65639fb5d7 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/ips" status: 200 len: 146 microversion: 2.1 time: 0.041975 May 30 12:08:48.306771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 143/290] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:48.359622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.360362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.370291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.371248 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.371532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.372004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.382393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.397240 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-26ffe83e-7e48-44e7-b4be-54d3edc6e952 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1498 microversion: 2.1 time: 0.203124 May 30 12:08:48.399020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 148/291] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1498 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:48.512257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.523353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b4242f56-bc30-45ca-b3eb-646935582907 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.168209 May 30 12:08:48.524133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 144/292] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:48.524382 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.524981 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.531370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.531936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.532706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.533146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.719495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:48.720137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:48.727315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.728084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.729060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:48.729502 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:48.781214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.790649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.792191 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.793750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cc83d432-8a84-4f8c-87c0-941e7313bb65 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.273536 May 30 12:08:48.794456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 149/293] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:48.821261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:48.829605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ec569d08-8cbd-4ae4-ab58-99e753a1136c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1293 microversion: 2.1 time: 0.113890 May 30 12:08:48.835227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 145/294] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:49.005668 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.006274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.012283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.012729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.013482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.013913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.143661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.151146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e6613fdd-3289-4671-a5cc-be7241bd06ca tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.150104 May 30 12:08:49.151704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 150/295] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:48 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:49.318640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.319148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.325700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.326147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.326943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.327862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.353717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:08:49.421074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:49.433933 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ed28d1ba-ca93-4603-855a-b905acf415b2 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "DELETE /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 204 len: 0 microversion: 2.1 time: 0.119843 May 30 12:08:49.434638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 146/296] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:08:49 2022] DELETE /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:08:49.445115 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.445818 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.452064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.452578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.453351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.453824 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.540779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.541503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.548714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.549432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.550392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.551004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.594475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.605927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e671fb7d-4371-4eae-a4ac-ae50ec027d16 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1504 microversion: 2.1 time: 0.166314 May 30 12:08:49.606612 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 151/297] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:49 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:49.702562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.710554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2d94ad9b-c20f-4dbf-ac66-52edf6c790f1 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.174042 May 30 12:08:49.711154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 147/298] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:49 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:49.812215 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.813343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.820598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.821234 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.822276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.822869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.847254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:49.848628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:49.854805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.855240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.856027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:49.856463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:49.886400 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:49.942915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.950559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9be416a5-4583-4f1b-be78-78df4c3abf0f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1311 microversion: 2.1 time: 0.107736 May 30 12:08:49.951402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 148/299] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:49 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:49.970492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.979251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.980750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:49.981909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-69aca967-5694-4212-af76-a9dea610388a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.173539 May 30 12:08:49.982495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 152/300] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:49 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:50.168150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.168760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.174656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.175679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.176535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.176971 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.314328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.321824 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-93d44273-bd29-4d65-a555-9f0c0e92868a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.157426 May 30 12:08:50.322390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 149/301] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:50.623932 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.625008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.632206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.632565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.633348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.633786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.729766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.730376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.736862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.737308 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.738611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.739037 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.778857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.787654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-213ec4cd-ed98-451a-a452-010c5162e5a9 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1504 microversion: 2.1 time: 0.167996 May 30 12:08:50.792993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 153/302] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:50.874102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:50.883084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9b7d8143-8153-4f87-8f5b-1473bbf1e911 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.157437 May 30 12:08:50.883739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 150/303] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:50.898268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0db61a2f-a4cf-447b-bf8d-43b83d0b3594"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:50.900010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.906693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.907155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.907953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.908399 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.976715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:50.977437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:50.986385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.986845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:50.988674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:50.989280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.085903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.093724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-101c7a3b-0804-4b56-bff8-a10b5db986a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1311 microversion: 2.1 time: 0.129609 May 30 12:08:51.094287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 151/304] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:50 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1311 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:51.099965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:51.100924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:51.108031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.108541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.109981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.110497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.248456 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.256869 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.258369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.259532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-23cc385e-29c3-40f5-8048-12e95a6be6b2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.163796 May 30 12:08:51.260137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 152/305] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:51 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:51.338464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:51.339027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:51.344965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.345413 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.346172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.346604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.483125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:51.491712 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5a71255e-4efa-495c-a574-74036d476594 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.157063 May 30 12:08:51.492317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 153/306] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:51 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:51.806111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:51.807283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:51.813829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.814345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.815168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:51.815651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:51.821063 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:52.049810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.058261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a4e6ee12-9dbb-4d02-884d-366ec20a73b1 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1504 microversion: 2.1 time: 0.255951 May 30 12:08:52.058846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 154/307] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:51 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:52.063500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.064137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.070724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.071178 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.072076 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.072405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.270406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.278167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-be1d9103-f46a-4ab6-964c-e2718b210b37 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.218109 May 30 12:08:52.278998 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 155/308] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:52.292834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.293533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.299549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.300148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.301000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.301447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.401297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.409042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b0e1a48e-211d-49ba-aebe-b705c048bc97 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1299 microversion: 2.1 time: 0.119920 May 30 12:08:52.410439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 156/309] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:52.415420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.416302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.422650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.423355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.424373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.425077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.692360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.703490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.705220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.706872 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4158a0b9-9a21-41c7-b932-74d197bd445b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.295218 May 30 12:08:52.707589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 157/310] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:52.725027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:52.725946 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:52.734823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.735603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.737235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:52.738242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:52.973639 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:52.981970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-87e5bf45-6dad-45ab-b223-1099a0269000 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.273070 May 30 12:08:52.982817 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 158/311] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:52 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:53.075496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.076144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.093864 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.094565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.095353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.095808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.355370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.365216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-79514221-f2d8-4081-b274-3b45141220e8 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1504 microversion: 2.1 time: 0.292950 May 30 12:08:53.366130 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 159/312] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:53.372011 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.372637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.380286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.380495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.381833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.382317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.823013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d645971d-3fb5-4088-9b6e-9a68633fd95b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.929588 May 30 12:08:53.823693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 154/313] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:08:50 2022] POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments => generated 194 bytes in 2931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:53.830503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.831381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.838853 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.839490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.840637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.841415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.887787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:53.902471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-15f42fec-6b02-411c-bcc1-8149c312f4dc tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.534794 May 30 12:08:53.906691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 160/314] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:53.921065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:53.921894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:53.933782 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.934664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.935665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:53.935865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:53.988643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.007218 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-849f38e1-6724-44da-95da-8ebea63db507 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1299 microversion: 2.1 time: 0.178340 May 30 12:08:54.011152 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 155/315] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1299 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:54.024597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:54.025350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:54.032515 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.033193 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.034088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.035227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.270464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.281735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.283745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.286491 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e83389d5-08df-4923-86a5-099ec458fbf0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.369179 May 30 12:08:54.287351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 161/316] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:53 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:54.386434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:54.387307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:54.399723 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.400449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.402175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.402770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.609296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.617615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-633d1971-6f1c-41f7-a28b-9fee17ba527b tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1504 microversion: 2.1 time: 0.237490 May 30 12:08:54.620195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 162/317] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:54 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1504 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:54.635441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:54.644282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c9f23655-e11c-435a-bdcb-c051e4e469b5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.629625 May 30 12:08:54.644962 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 156/318] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:54 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:54.922574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:54.923487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:54.932458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.933105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:54.934228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:54.934821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.048326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.049555 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.061698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.062576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.064693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.065322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.394554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.403366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-55ce8ab6-53ad-4fbb-9d4e-2487c59333eb tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.484722 May 30 12:08:55.403981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 163/319] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:54 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:55.434482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.435403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.437202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.449924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.450387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.451247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-15cf62c6-6b93-4789-af2f-8a1a3e1fc6f2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.415117 May 30 12:08:55.451391 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.451842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.459431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 157/320] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:55.466992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-c1ba2ea2-5238-4153-914b-6d29949b3f51 req-eb693bee-128e-4d5b-b8ed-561fcd03eead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01da7b9e-4547-47d3-80fd-a3732fc2d367", "name": "network-vif-deleted", "tag": "1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:55.506547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-c1ba2ea2-5238-4153-914b-6d29949b3f51 req-eb693bee-128e-4d5b-b8ed-561fcd03eead service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.508891 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-c1ba2ea2-5238-4153-914b-6d29949b3f51 req-eb693bee-128e-4d5b-b8ed-561fcd03eead service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.533749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-c1ba2ea2-5238-4153-914b-6d29949b3f51 req-eb693bee-128e-4d5b-b8ed-561fcd03eead service nova] Creating event network-vif-deleted:1d3fb614-55ec-4ffd-babe-7ac3c22d8e1c for instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 on hv-cinder-83979 May 30 12:08:55.540592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-c1ba2ea2-5238-4153-914b-6d29949b3f51 req-eb693bee-128e-4d5b-b8ed-561fcd03eead service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079781 May 30 12:08:55.541804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 158/321] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:55.636788 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.637779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.648127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.650743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.655336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.656703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.711544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.724839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.726734 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.733022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-17e7f236-d380-4982-9723-4fe81bea3be5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.327801 May 30 12:08:55.734063 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 164/322] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:55.740440 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:55.741061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:55.756070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.756530 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.759495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.761259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.837057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6c7d188b2764872b2bd3245e1a7ab1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fa1cd28ccbd46a2925b432e3ff62c3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:55.859198 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9f638759-4e19-456c-9581-142363c5aa56 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 200 len: 1298 microversion: 2.1 time: 0.228187 May 30 12:08:55.860444 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 159/323] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 1298 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:55.873281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-8ec135fb-a0e0-4117-be87-832ae0dbc957 req-31ff9bc4-17cc-469b-bc69-bc551723e277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c", "name": "network-vif-plugged", "status": "completed", "tag": "bd575b1f-86bb-4b14-833d-fece382bc5a6"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:55.897247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-8ec135fb-a0e0-4117-be87-832ae0dbc957 req-31ff9bc4-17cc-469b-bc69-bc551723e277 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:55.897698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-8ec135fb-a0e0-4117-be87-832ae0dbc957 req-31ff9bc4-17cc-469b-bc69-bc551723e277 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:55.929533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-8ec135fb-a0e0-4117-be87-832ae0dbc957 req-31ff9bc4-17cc-469b-bc69-bc551723e277 service nova] Creating event network-vif-plugged:bd575b1f-86bb-4b14-833d-fece382bc5a6 for instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c on hv-cinder-83979 May 30 12:08:55.944100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-8ec135fb-a0e0-4117-be87-832ae0dbc957 req-31ff9bc4-17cc-469b-bc69-bc551723e277 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079207 May 30 12:08:55.944865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 160/324] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:08:56.103766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:56.120790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fdad0a1b-4766-4e92-8e22-960a85eeae73 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.385405 May 30 12:08:56.121813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 165/325] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:55 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:56.422159 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:56.422821 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:56.449282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.449662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.459913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.460995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.477939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:56.478770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:56.515601 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.517359 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.521335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.523709 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.905647 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:56.916991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7d788826-ee2a-45c2-89ef-0e05e8b8f42d tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.444714 May 30 12:08:56.917916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 166/326] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:56 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:56.933081 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:56.933911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:56.941927 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.942211 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:56.943025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:56.943490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.057484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:57.078237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f5a4f4f6-6417-4f7d-883a-92b59791125f tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.661153 May 30 12:08:57.093206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 161/327] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:56 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:57.099654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:57.103173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] [instance: 01da7b9e-4547-47d3-80fd-a3732fc2d367] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:57.116171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.116851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.117837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.118281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.155854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] HTTP exception thrown: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Request method failure captured: May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 HTTP/1.1 May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLOkOV0lfNku2z4vbtjtVHyqynTkPr5vJraWz8EAI2DbuA-5zjrWgHElU9vWRPH6H_EjSBZ6_GseEFMfSamqwiu0aWK_CZ1w4zg0lamK6SmWhpLPytskm6syoJhD6SvLHnXLoZYmmhkKQmjjAinQaOlDiO-TaJF-SA7yOyJkq9cXZTw May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 0fa1cd28ccbd46a2925b432e3ff62c3f May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesActionsTest-340550524 May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:08:57.157534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_0fa1cd28ccbd46a2925b432e3ff62c3f", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/0fa1cd28ccbd46a2925b432e3ff62c3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesActionsTest-340550524 May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 0fa1cd28ccbd46a2925b432e3ff62c3f May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesActionsTest-340550524 May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesActionsTest-340550524-project May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: b6c7d188b2764872b2bd3245e1a7ab1a May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesActionsTest-340550524-project May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. May 30 12:08:57.159201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '01da7b9e-4547-47d3-80fd-a3732fc2d367'} May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:08:57.160324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. May 30 12:08:57.162462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:08:57.164439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] Returning 404 to user: Instance 01da7b9e-4547-47d3-80fd-a3732fc2d367 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:08:57.165781 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-347699b5-b9ee-4014-8324-cf884fdd0799 tempest-VolumesActionsTest-340550524 tempest-VolumesActionsTest-340550524-project] 10.222.0.41 "GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367" status: 404 len: 111 microversion: 2.1 time: 0.071188 May 30 12:08:57.166802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 162/328] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:57 2022] GET /compute/v2.1/servers/01da7b9e-4547-47d3-80fd-a3732fc2d367 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:08:57.175690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:57.176482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:57.182711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.183219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.184934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.185381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.330448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:57.340882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:57.343404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:57.343788 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1ce40ee6-b0fd-4cb9-93d7-47de7133d609 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.414710 May 30 12:08:57.344490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 167/329] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:56 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:08:57.431324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:57.447341 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7bbbf04d-0adc-4ab4-be09-7d915aeb7b4e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.279131 May 30 12:08:57.448241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 163/330] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:57 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:57.576010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-3f343e9b-98f4-4a6f-908d-4e0f57bfab3c req-cfc8005b-5872-4048-9cae-0f4e42a37ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea5b29cb-133f-4082-a3f5-5094e70ccb3f", "tag": "76cb0fb8-baf2-460c-8a68-05140c3ee881"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:08:57.581676 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:57.583187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=6 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:57.589839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3f343e9b-98f4-4a6f-908d-4e0f57bfab3c req-cfc8005b-5872-4048-9cae-0f4e42a37ebe service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.592618 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3f343e9b-98f4-4a6f-908d-4e0f57bfab3c req-cfc8005b-5872-4048-9cae-0f4e42a37ebe service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.625836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-3f343e9b-98f4-4a6f-908d-4e0f57bfab3c req-cfc8005b-5872-4048-9cae-0f4e42a37ebe service nova] Creating event network-changed:76cb0fb8-baf2-460c-8a68-05140c3ee881 for instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f on hv-cinder-83979 May 30 12:08:57.640877 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-3f343e9b-98f4-4a6f-908d-4e0f57bfab3c req-cfc8005b-5872-4048-9cae-0f4e42a37ebe service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065845 May 30 12:08:57.646677 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 168/331] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:08:57.939469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:57.941200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:57.951787 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=14 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:57.952967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:57.955127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.956549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:57.958042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:57.958951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.103536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:58.104402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:58.119694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.120281 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.121476 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.122302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.180406 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.192733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-213639e4-16d9-4bb2-8f2c-5a582e61af58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.261264 May 30 12:08:58.193312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 164/332] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:57 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:58.362777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:58.363552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:58.367181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.374248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.374665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.375638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.376262 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.387051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-905cda95-8f31-4db8-b85e-931020746f8c tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.292843 May 30 12:08:58.394380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 169/333] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:58 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:58.463963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:58.464609 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:58.471422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.472042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.472829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:58.473270 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:58.548998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.551762 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:58.560471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.562203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.563562 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a34b0671-8d2f-45dd-8bd0-b6084bc447a0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.204813 May 30 12:08:58.564444 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 165/334] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:58 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:08:58.667717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:58.675946 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-71e574d7-ee73-4732-b45c-0b7ca3ada5e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.216057 May 30 12:08:58.676509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 170/335] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:58 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:59.211316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:59.212828 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:59.222285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.223386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.224554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.225393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.413170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:59.414178 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:59.421468 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.422329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.423311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.423945 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.437000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.443096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:08:59.449944 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-689d2a0c-c72b-4791-811b-5b04812cf438 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.243259 May 30 12:08:59.460074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 166/336] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:59 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:08:59.589712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:59.591206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:59.597670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.598363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.598995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.601394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.602630 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.606703 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8e08205d-bbab-45a6-9a32-dd49e5e521d9 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.197418 May 30 12:08:59.608739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 171/337] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:59 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:59.693373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:08:59.694028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:08:59.700403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.700880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.702397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:08:59.703002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:08:59.860294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.861081 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.877277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.879059 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:08:59.880513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8d62c263-2d2d-402d-87f4-749a69b13f34 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.191749 May 30 12:08:59.881116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 172/338] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:08:59 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:08:59.882653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f7057069-4748-4eff-82ca-298a85fd6483 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.299246 May 30 12:08:59.893696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 167/339] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:08:59 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:00.467299 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.467941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.477727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.478550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.479424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.479967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.631994 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:00.640163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9fcfc9a5-f9f6-466f-8f39-b37e15f59da5 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.176643 May 30 12:09:00.640423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.641210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 173/340] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:00.645812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.658496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.660325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.661039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.661838 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.898006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.898778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.905256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.905744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.906815 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.907408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.957378 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:00.967309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a4f28906-167d-4c7b-a0d3-817399ce0db4 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.343845 May 30 12:09:00.970141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 168/341] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:00.975665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:00.976210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:00.993109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.997521 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:00.999136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:00.999731 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:01.203964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:01.215395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bbb25a06-fe42-46a5-b643-e12c25d6ba65 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.321690 May 30 12:09:01.218175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 174/342] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:01.364761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:01.376565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:01.378931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:01.380597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da0b3efe-585f-4141-8bd7-97c8e608f5f0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.408980 May 30 12:09:01.395995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 169/343] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:00 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:01.658977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:01.660937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:01.668836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:01.669866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:01.670810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:01.671404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:01.905147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:01.916529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1d953a12-6af7-485b-bf31-32beb5ae8608 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.262103 May 30 12:09:01.917772 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 175/344] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:01 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:01.985808 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:01.986459 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:02.004152 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.007378 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.008550 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.009156 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.234821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:02.235440 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:02.254794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.255374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.256415 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.260005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.416812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:02.454504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-54b2cee2-fb54-452f-8036-341c80e3472b tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1315 microversion: 2.1 time: 0.472991 May 30 12:09:02.483797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 170/345] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:01 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:02.498059 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:02.498697 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:02.529135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.530651 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.531484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.532132 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.612828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:02.624057 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bcb2cd23-5c4d-454e-bbf2-48274edecc9b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.393144 May 30 12:09:02.625360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 176/346] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:02 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:02.637108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-ee200798-bf9a-4df6-8a22-2dda21efbce2 req-6168e872-6013-4253-98de-682081091a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "name": "network-vif-plugged", "status": "completed", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:02.668040 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ee200798-bf9a-4df6-8a22-2dda21efbce2 req-6168e872-6013-4253-98de-682081091a6d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.676281 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ee200798-bf9a-4df6-8a22-2dda21efbce2 req-6168e872-6013-4253-98de-682081091a6d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.726550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-ee200798-bf9a-4df6-8a22-2dda21efbce2 req-6168e872-6013-4253-98de-682081091a6d service nova] Creating event network-vif-plugged:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:09:02.735205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-ee200798-bf9a-4df6-8a22-2dda21efbce2 req-6168e872-6013-4253-98de-682081091a6d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107976 May 30 12:09:02.736098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 177/347] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:02.936151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:02.942770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:02.955660 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.957156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:02.958141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:02.958807 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:03.088348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:03.111344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:03.114939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:03.124505 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-db93a559-f3f0-4a7e-8066-2903f4af08a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.635573 May 30 12:09:03.125314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 171/348] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:02 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:03.254872 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:03.264912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7caa83d0-daae-49f0-bbc9-0e9b9dce6aaf tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.334739 May 30 12:09:03.265506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 178/349] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:02 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:03.500790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:03.501941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:03.517953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:03.540049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:03.541982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:03.542790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:03.655765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:03.665867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:03.679523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:03.680151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:03.680948 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:03.682616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:03.980861 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:03.997832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fe3658ad-2b36-42ec-b13f-3a5e5fcc9917 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.358136 May 30 12:09:03.999364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 179/350] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:03 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:04.044436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:04.059683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ebbefec0-06ac-4b11-a511-c03f110195fd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1465 microversion: 2.1 time: 0.561087 May 30 12:09:04.068661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 172/351] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:03 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1465 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:04.133125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:04.133803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:04.148121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:04.148742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:04.149405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.153130 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.154972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.157934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.158932 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.159904 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.160782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.161217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.195924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:09:04.385844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e8f7627d-efb2-4e7c-9786-dd12231454bd tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 204 len: 0 microversion: 2.1 time: 0.255681 May 30 12:09:04.391136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 180/352] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:09:04 2022] DELETE /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:09:04.400898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:04.401744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:04.409322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.409903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.410763 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.411324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.557429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:04.567537 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:04.569136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:04.581061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-530a846c-75c6-4f03-a7f1-9ec2d7d37544 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.438006 May 30 12:09:04.582055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 173/353] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:04 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:04.588475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:04.602491 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:04.611176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.611635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.616804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:04.620442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:04.684767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:04.701088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a57cb5a0-13f6-49d0-b4ea-0cfc6732d62a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.304476 May 30 12:09:04.705597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 181/354] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:04 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:05.016679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:05.018129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:05.040826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.041278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.042147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.042582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.298596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:05.319584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2c581abe-be10-4a7d-a424-7b0e815e0b5f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.307508 May 30 12:09:05.320525 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 182/355] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:05 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:05.455856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:05.468825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5f0215f3-b878-4f50-9351-f40335108a29 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1471 microversion: 2.1 time: 0.885864 May 30 12:09:05.469399 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 174/356] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:04 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1471 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:05.602891 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:05.603497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:05.613180 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.613626 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.614399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.614826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.722570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:05.723112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:05.731202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.731656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.732762 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:05.733199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:05.860815 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:05.869632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:05.871128 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:05.872652 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b3dd35b7-127c-4875-ad3e-873ae02f240c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1744 microversion: 2.20 time: 0.273762 May 30 12:09:05.874440 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 183/357] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:05 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1744 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:06.126738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:06.136132 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c074f6af-60fc-4c92-8da5-8e3eb9303a06 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.417349 May 30 12:09:06.137281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 175/358] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:05 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:06.336722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:06.337494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:06.344010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.344548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:06.345420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.345993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:06.549541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-42ce8c3c-dbcf-4552-9f32-f4bfd5a2b1fe tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Action: 'create', calling method: .version_select at 0x7f61a1cb14c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-261961072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/2BPdjWWNQvWqBSeTHK8d35PmlyhBgCqMkOK8P3MzVada0vKRSO1b9IJQYZaTQE6Iusnc+4gubbtJ8tPZwQaHHEBGVhtfQdXKU0Q009Cz9o+ZBFSIgVK0jUlYmlMRvqA=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:06.555144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:06.569093 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d81e77de-ab00-400b-b32e-aa9f38a3a10b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.236124 May 30 12:09:06.569934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 176/359] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:06 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:06.585164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:06.589349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:06.600143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-42ce8c3c-dbcf-4552-9f32-f4bfd5a2b1fe tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for project 4249e846c5d54876a6ed97678450c1d2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:09:06.601715 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.603746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:06.604731 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.605303 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:06.617222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-42ce8c3c-dbcf-4552-9f32-f4bfd5a2b1fe tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for user f7e7ce32b4c0457196c8765d6c5ada7e and project 4249e846c5d54876a6ed97678450c1d2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:09:06.655376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-42ce8c3c-dbcf-4552-9f32-f4bfd5a2b1fe tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.426016 May 30 12:09:06.656780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 184/360] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:09:06 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:06.892252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:06.893212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:06.909381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.912708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:06.920763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ebe0c0ab-1670-4f9e-bf96-c8e2708a0956 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1471 microversion: 2.1 time: 0.340807 May 30 12:09:06.921327 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 177/361] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:06 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:06.932462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:06.933573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:06.934014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.161467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:07.164013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:07.182553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.185113 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.186845 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.187477 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.311453 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:07.324582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:07.330950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:07.335589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-795dcbc3-c8d9-4f49-9dba-2492b8189edd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.445773 May 30 12:09:07.338174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 185/362] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:06 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:07.577502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:07.586529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:07.588107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:07.605435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.609586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4d859915-b904-43fe-b8f2-64f64bb92087 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.456890 May 30 12:09:07.610701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.614136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.624536 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 178/363] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:07 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:07.625507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.884282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:07.907487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-190cb926-8197-4073-a828-8ce848f685bd tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.324882 May 30 12:09:07.915174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 186/364] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:07 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:07.944406 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:07.946510 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:07.959804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.960325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:07.962172 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:07.962590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.217229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:08.232749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5aa114c8-b211-42ca-96e3-c5453bb95c5a tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1471 microversion: 2.1 time: 0.297174 May 30 12:09:08.245278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 179/365] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:07 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:08.358469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:08.361053 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:08.372819 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:08.375326 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.376263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.377446 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.379010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.422185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f0954c62-ef2e-46c1-bb9c-bf08abd82a1b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:08.429469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0954c62-ef2e-46c1-bb9c-bf08abd82a1b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.430242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0954c62-ef2e-46c1-bb9c-bf08abd82a1b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.516894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f0954c62-ef2e-46c1-bb9c-bf08abd82a1b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Going to try to stop instance {{(pid=117706) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 30 12:09:08.590319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f0954c62-ef2e-46c1-bb9c-bf08abd82a1b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action" status: 202 len: 0 microversion: 2.1 time: 0.175300 May 30 12:09:08.596754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 180/366] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:09:08 2022] POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:08.603939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:08.604867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:08.660474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.663447 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.670239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.672417 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.732750 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:08.754332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:08.757024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:08.758563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-758fb742-fae5-4799-bf13-276ca2dd9139 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.406180 May 30 12:09:08.760377 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 187/367] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:08 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:08.795505 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:08.796783 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:08.817175 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:08.822394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.822851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.823655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:08.832398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:08.845335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:09.499159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:09.511483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d0f0ffde-06b4-49d1-b8b1-7f45876c8330 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.749790 May 30 12:09:09.520276 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 188/368] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:08 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:09.531593 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:09.541233 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:09.566019 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.566899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:09.570263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.571326 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:09.610949 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:09.629447 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-15651ad2-a3fa-4b7a-8e7a-0c2e9a1a97c8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 1.030286 May 30 12:09:09.633229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 181/369] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:08 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:09.664921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:09.667304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:09.725311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.725761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:09.726568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:09.727015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.045104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.060444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f4d9b5b2-09f9-47d7-b9de-44a03b89ab79 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.538541 May 30 12:09:10.061030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 189/370] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:09 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:10.068232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:10.069035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:10.085184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.085923 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.086877 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.087469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.390217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.402666 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.407997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.410822 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0fd67cd1-0512-481a-8fc4-bd1ca9a4bdcb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.348656 May 30 12:09:10.412902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 190/371] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:10 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:10.428682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-ed70ddbd-6029-455d-ae0f-27e0c55ff6d4 req-9df77809-673d-4f05-8f5c-102ff38d3bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5b29cb-133f-4082-a3f5-5094e70ccb3f", "name": "network-vif-plugged", "status": "completed", "tag": "76cb0fb8-baf2-460c-8a68-05140c3ee881"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:10.453746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ed70ddbd-6029-455d-ae0f-27e0c55ff6d4 req-9df77809-673d-4f05-8f5c-102ff38d3bec service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.454794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ed70ddbd-6029-455d-ae0f-27e0c55ff6d4 req-9df77809-673d-4f05-8f5c-102ff38d3bec service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.486664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-ed70ddbd-6029-455d-ae0f-27e0c55ff6d4 req-9df77809-673d-4f05-8f5c-102ff38d3bec service nova] Creating event network-vif-plugged:76cb0fb8-baf2-460c-8a68-05140c3ee881 for instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f on hv-cinder-83979 May 30 12:09:10.499329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-ed70ddbd-6029-455d-ae0f-27e0c55ff6d4 req-9df77809-673d-4f05-8f5c-102ff38d3bec service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082944 May 30 12:09:10.502275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 191/372] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:10.531504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:10.532651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:10.543971 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.544916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.546523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.547234 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.764680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.778765 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9d9884a2-82b2-463c-920c-95a24a1bd354 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1471 microversion: 2.1 time: 1.139827 May 30 12:09:10.785328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:10.786468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 182/373] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:09 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1471 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:10.793839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5c345b4a-3f40-439e-9ae9-e85dc4288f58 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.266770 May 30 12:09:10.794808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 192/374] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:10 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:10.800631 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:10.801267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:10.823493 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.823983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:10.824782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:10.825212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.077769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.078389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.098162 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.106551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.107867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.108297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.515697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.528255 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3c47577b-6fb9-458d-9980-eb24a127c4a6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1521 microversion: 2.1 time: 0.452561 May 30 12:09:11.529091 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 193/375] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:11.535143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.547149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.559050 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.559648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.560550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.561127 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.734463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.749853 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8d4d5150-6127-4499-aa88-46aa6e153cdd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.962200 May 30 12:09:11.752916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 183/376] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:10 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:11.758000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-eba79c55-ee84-42b7-ae93-3518352c28f6 req-b26216c5-bd2d-421a-ab6e-789fd3f63e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c", "name": "network-vif-deleted", "tag": "bd575b1f-86bb-4b14-833d-fece382bc5a6"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:11.790969 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-eba79c55-ee84-42b7-ae93-3518352c28f6 req-b26216c5-bd2d-421a-ab6e-789fd3f63e6d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.792313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-eba79c55-ee84-42b7-ae93-3518352c28f6 req-b26216c5-bd2d-421a-ab6e-789fd3f63e6d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.820310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-eba79c55-ee84-42b7-ae93-3518352c28f6 req-b26216c5-bd2d-421a-ab6e-789fd3f63e6d service nova] Creating event network-vif-deleted:bd575b1f-86bb-4b14-833d-fece382bc5a6 for instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c on hv-cinder-83979 May 30 12:09:11.836060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-eba79c55-ee84-42b7-ae93-3518352c28f6 req-b26216c5-bd2d-421a-ab6e-789fd3f63e6d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081230 May 30 12:09:11.836701 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 184/377] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:11.850662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.852618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.867547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.868013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.868857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.869953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.880967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.903874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.910833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:11.914677 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b98c0ce1-46ad-4807-99fd-13041ac48811 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.383426 May 30 12:09:11.918113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 194/378] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:11.933679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:11.934298 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:11.942648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.943106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:11.943944 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:11.944413 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.045919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:12.055393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e4e7b2ab-9d9f-46f3-b9aa-6231ad2f7384 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1429 microversion: 2.1 time: 0.212633 May 30 12:09:12.056314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 185/379] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:12.392617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:12.404229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b571cb52-2f08-4ed1-b8fb-5adf5689a38e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.484683 May 30 12:09:12.405013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 195/380] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:11 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:12.545080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:12.546126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:12.558866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.558866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.559589 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.560097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.772135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:12.773184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:12.793745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.794390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.794963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.795395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.866068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:12.879926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ed57487a-7039-42db-8036-0278dab16d2d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1501 microversion: 2.1 time: 0.338742 May 30 12:09:12.881124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 186/381] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:12 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:12.899562 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:12.900515 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:12.915047 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.915767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:12.916741 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:12.931182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.098888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.118495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-31c16896-5a2f-4ecb-aa3a-e0ebac550e5b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.352074 May 30 12:09:13.119693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 196/382] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:12 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:13.125694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:13.126612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:13.134350 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.135274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.138867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.139870 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.142388 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.151277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2c532ea7-77ed-4fcb-96ca-a7b4ebb5c0f8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1514 microversion: 2.1 time: 0.258687 May 30 12:09:13.183158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 187/383] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:12 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:13.214875 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:13.215547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:13.247976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.250194 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.251158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.255972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.335175 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.337362 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.340041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lazy-loading 'fault' on Instance uuid 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:13.374005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.391038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.511571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6451c3ad6dc4a7b82b25dbfbd100965', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd22b1bc83bba4f8e9deafc253449e8ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.524323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:13.527261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c919ef38-22e5-4d48-baac-5cf28cb84a67 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 200 len: 1305 microversion: 2.1 time: 0.341318 May 30 12:09:13.529068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f157358f-060f-448f-8403-3dd60e614835 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.407215 May 30 12:09:13.530283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 197/384] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:13 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:13.533749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 188/385] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:13 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 1305 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:13.554143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:13.560356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:13.693049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.693049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:13.693049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:13.693049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.137129 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:14.137908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:14.151978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.154916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.157527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:14.157924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.163695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.171252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-67301407-3b86-4ad4-9145-fae9bf4a5dce tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1366 microversion: 2.1 time: 0.637555 May 30 12:09:14.176255 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 198/386] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:13 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:14.479673 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:14.501180 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e77a6606-1426-4df5-9fd0-1956fe11e90a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.368467 May 30 12:09:14.512254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 189/387] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:14 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:14.635072 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:14.635746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:14.644571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.644571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.645355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.645725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.662414 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:14.663039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] [instance: 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:14.672355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.672775 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.677982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:14.678716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:14.718033 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] HTTP exception thrown: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Request method failure captured: May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c HTTP/1.1 May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLPF9znpmq2iQjNVM8Q9JlYNJffCEPlepzSEW98miCXF-16CniQpqQgbji-_gVMWBmdc-Yhuo8sF-OzxI1_JQ2BJbu4Kxpml4KSnylOCaIFRKdTQzXV03n5o81nYDHDiVExfQvQAJwD3abVnmkp6YPfi1E7mgYzyeBdRj4ahU03PPos May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: d22b1bc83bba4f8e9deafc253449e8ab May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesNegativeTest-1054424542 May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:09:14.719699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/d22b1bc83bba4f8e9deafc253449e8ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_d22b1bc83bba4f8e9deafc253449e8ab", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d22b1bc83bba4f8e9deafc253449e8ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/d22b1bc83bba4f8e9deafc253449e8ab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesNegativeTest-1054424542 May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: d22b1bc83bba4f8e9deafc253449e8ab May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesNegativeTest-1054424542 May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesNegativeTest-1054424542-project May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: c6451c3ad6dc4a7b82b25dbfbd100965 May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesNegativeTest-1054424542-project May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. May 30 12:09:14.721376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c'} May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:14.722576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. May 30 12:09:14.724507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:09:14.725892 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] Returning 404 to user: Instance 4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:14.725892 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-38fb9a99-0411-4cfa-9125-3c17a5722541 tempest-VolumesNegativeTest-1054424542 tempest-VolumesNegativeTest-1054424542-project] 10.222.0.41 "GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c" status: 404 len: 111 microversion: 2.1 time: 0.063312 May 30 12:09:14.737926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 190/388] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:14 2022] GET /compute/v2.1/servers/4ff9a5b4-2ead-4f72-b83b-1852cb6c3b1c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:09:14.884845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:14.894114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:14.895888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:14.897326 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-516305b7-290a-402b-bf8e-dd35c7c804de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.266802 May 30 12:09:14.898595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 199/389] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:14 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:15.200429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:15.202094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:15.220671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.221548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.222507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.224040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.484748 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:15.493651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:15.528843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.539878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.541123 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.545429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.619154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'flavor' on Instance uuid d2484e75-927b-450d-9638-6e57fc7f7e32 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:09:15.634416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:15.648415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-22fac43e-0368-47c0-8e82-70ff4af18a25 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1557 microversion: 2.1 time: 0.459105 May 30 12:09:15.651312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 191/390] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:15 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1557 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:15.661979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:15.668161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:15.678921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.679724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.699527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.701491 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.803336 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-58ac9b1f-1da0-4be4-b4ca-5b974f818a4d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/action" status: 200 len: 32 microversion: 2.1 time: 0.322655 May 30 12:09:15.805133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 200/391] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:09:15 2022] POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/action => generated 32 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 30 12:09:15.811151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:15.812425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:15.820232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.820941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.822446 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.823052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.914399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d9a8ee57-32c9-4061-bad0-1eebf69fb5c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.107668 May 30 12:09:15.915681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 201/392] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:09:15 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:15.921445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:15.922312 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:15.936624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.937333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.941235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:15.941879 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:15.988856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.000677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-20844361-4c06-41c4-8440-382661dc3328 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.348026 May 30 12:09:16.002946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 192/393] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:15 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:16.007952 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:16.008747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:16.022227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.023099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.026366 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:16.027000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:16.393601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.416851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.418639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.420048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-eacbcdfe-9719-47d5-8efc-2c66ba900d67 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.415880 May 30 12:09:16.420776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 193/394] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:16 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:16.560179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:16.570441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5500807f-81d9-477a-bfc9-6ca6fa4946ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.652730 May 30 12:09:16.575499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 202/395] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:15 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:17.019786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:17.022348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:17.046481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.047390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.048563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.051833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.368241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:17.381070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d813fcbe-af67-4969-a4a5-eba3974eb4cc tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.362767 May 30 12:09:17.392597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 194/396] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:17 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:17.438871 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:17.439623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:17.442389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:17.451193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.456191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.457172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.457704 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.595701 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:17.598097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:17.605075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.606415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.607855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:17.608481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:17.805259 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:17.817291 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7125dd34-9e3f-4eeb-a560-85ec6ffad3e7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.228384 May 30 12:09:17.818660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 195/397] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:17 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:17.941751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:17.944943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:17.958662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:17.963968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:17.966604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-efd707fb-0e1f-4a76-bcee-94c67cd14957 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.531506 May 30 12:09:17.992256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 203/398] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:17 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:18.357510 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-d4d4ea4e-2021-49eb-b72d-c525e8956506 req-2e972982-1ff4-425e-95e9-460aa41ff1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea5b29cb-133f-4082-a3f5-5094e70ccb3f", "tag": "76cb0fb8-baf2-460c-8a68-05140c3ee881"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:18.372413 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d4d4ea4e-2021-49eb-b72d-c525e8956506 req-2e972982-1ff4-425e-95e9-460aa41ff1ea service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:18.373142 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d4d4ea4e-2021-49eb-b72d-c525e8956506 req-2e972982-1ff4-425e-95e9-460aa41ff1ea service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:18.404910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:18.405528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:18.409287 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-d4d4ea4e-2021-49eb-b72d-c525e8956506 req-2e972982-1ff4-425e-95e9-460aa41ff1ea service nova] Creating event network-changed:76cb0fb8-baf2-460c-8a68-05140c3ee881 for instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f on hv-cinder-83979 May 30 12:09:18.414689 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:18.420968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:18.422682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:18.425244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:18.448951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-d4d4ea4e-2021-49eb-b72d-c525e8956506 req-2e972982-1ff4-425e-95e9-460aa41ff1ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164178 May 30 12:09:18.454854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 196/399] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:18.753924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:18.792119 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3d4d0677-9e68-4497-8d74-1ab0074bc48d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.367865 May 30 12:09:18.792119 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 204/400] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:18 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:18.839676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:18.840416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:18.848596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:18.849047 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:18.850175 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:18.850622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:18.991571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:18.992817 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:18.999912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:19.000857 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:19.001802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:19.002925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:19.150062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:19.162964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ebe6ac5c-5106-4bbd-92c1-d33db8fb404c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.327208 May 30 12:09:19.172420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 197/401] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:18 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:19.292334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:19.302060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:19.309602 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:19.316734 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4434e606-e9dd-43b2-be1e-2416dfbf15f4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.332565 May 30 12:09:19.319124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 205/402] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:18 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:19.825011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:19.825646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:19.833181 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:19.833639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:19.834427 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:19.840407 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.181214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:20.182688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:20.204172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.205081 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.206284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.206958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.208978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.219349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-798811e1-dc9f-47a2-a1b1-fd1f6d2ebb55 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.398252 May 30 12:09:20.219956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 198/403] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:19 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:20.341182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:20.341791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:20.365960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.366409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.374487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:20.375046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:20.513671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.523529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5e37341f-1689-4223-a555-8697094749b9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.346355 May 30 12:09:20.526951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 206/404] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:20 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:20.632932 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.635695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:20.646870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.648749 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:20.650096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0aab679a-8377-486a-8ca9-69396d58824b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.313043 May 30 12:09:20.650865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 199/405] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:20 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:21.240860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:21.241470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:21.261971 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.263143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.265361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.266366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.472416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:21.483776 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-86089d57-a1ff-4af2-9bc7-b293ca42285e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.249192 May 30 12:09:21.485003 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 207/406] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:21 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:21.545078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:21.546238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:21.562016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.562534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.563293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.563717 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.670168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:21.671156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:21.683993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.684968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.686188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:21.686835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:21.826743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:21.840723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-61107716-67c0-48b1-8e88-a9e4dcec49a7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.294813 May 30 12:09:21.840723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 200/407] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:21 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:22.038803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:22.049482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:22.051006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:22.052270 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-faaeebab-3ba1-46b0-94bb-c7c9e3f19156 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.386398 May 30 12:09:22.063021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 208/408] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:21 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:22.502907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:22.503529 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:22.509902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.510350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:22.511164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.511602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:22.700585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:22.713907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d91d0e7b-ca43-482e-a257-8138dabc1c32 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.215440 May 30 12:09:22.714506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 201/409] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:22 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:22.857848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:22.857848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:22.869495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.869936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:22.870691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:22.871121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.060983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.071438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:23.072210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:23.074650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a2b67905-e43e-477e-ae8f-644c5e0b7521 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.219898 May 30 12:09:23.079533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.080639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.082252 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.082936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.085673 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 209/410] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:22 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:23.297811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.312877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.317806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.318685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1e861d9c-5ad7-4b0d-8d93-5ee28dee853d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.251661 May 30 12:09:23.322485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 202/411] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:23 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:23.736396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:23.736396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:23.746172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.746614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.747458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:23.747929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:23.947648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:23.953810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4f69328b-b422-4f14-bccb-84d388f2aa83 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.224823 May 30 12:09:23.963879 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 210/412] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:23 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:24.092346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:24.092982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:24.100682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.101447 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.102363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.102911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.272744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:24.280593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8567445d-9218-4643-a4ba-8b085ad8b6de tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.192006 May 30 12:09:24.282736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 203/413] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:24 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:24.336804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:24.337412 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:24.352154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.353333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.354712 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.355392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.560615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:24.571796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:24.573732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:24.574917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5d9a804d-edc3-4d00-b8bc-edc96bb03e74 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1739 microversion: 2.20 time: 0.242202 May 30 12:09:24.575474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 211/414] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:24 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:24.971326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:24.972269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:24.986385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.987081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:24.987893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:24.988363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.215193 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.224927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e610a0df-ccb0-4e3c-a06b-2a72781ba02b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.258209 May 30 12:09:25.228139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 204/415] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:24 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:25.304523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.305810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.314260 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.315006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.316275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.316916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.497086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.506830 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ce6d6fcb-621e-42ff-bcd9-4604248f856e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.210260 May 30 12:09:25.508102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 212/416] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:25 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:25.595222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:25.596725 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:25.606323 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.606778 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.608056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:25.608501 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:25.907112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.917872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.920454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:25.921947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1b37394e-073f-4a96-ab86-fba08a0af77a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1721 microversion: 2.20 time: 0.331613 May 30 12:09:25.922751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 205/417] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:25 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1721 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:26.243315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:26.244543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:26.252500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.256410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.257584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.257702 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.406451 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:26.415755 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d0012905-f978-4c3e-9bf5-eb0eca11dd51 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.176818 May 30 12:09:26.430557 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 213/418] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:26 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:26.527981 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:26.529310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:26.536916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.537603 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.538660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.539310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.702394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:26.710813 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d1bdd8a0-29ce-48f5-8200-5ad6219e3515 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.188495 May 30 12:09:26.711381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 206/419] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:26 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:26.943879 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:26.945033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:26.952471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.953442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:26.954338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:26.955378 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.151213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.160969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.162471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.163691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e4e77ad6-b512-4102-9a04-cb0436a55624 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1721 microversion: 2.20 time: 0.225140 May 30 12:09:27.164296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 214/420] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:26 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:27.433453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:27.434067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:27.441187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.441629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.442387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.442813 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.595096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.604042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-459db651-cd36-4c29-aa39-a2e29b97bee1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.174237 May 30 12:09:27.604623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 207/421] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:27 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:27.728786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:27.729401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:27.736844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.737283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.738072 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:27.738504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:27.876145 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:27.885238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-279b69bc-980c-463d-8ab0-136458626b30 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.160479 May 30 12:09:27.885924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 215/422] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:27 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:28.182450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:28.183067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:28.184951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=90 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:28.190848 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.191311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.192117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.192559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.352472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:28.363153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:28.365052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:28.366595 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c2a5b7db-13bd-438b-87d2-4acc8e0b8da1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1721 microversion: 2.20 time: 0.188453 May 30 12:09:28.368206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 208/423] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:28 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:28.622296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:28.622905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:28.629238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.629780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.630441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.631115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.766736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-4c2e9c9e-13ee-4d48-90dd-d91ebe620423 req-74f35da8-b126-44a1-86df-1727c0f6ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "name": "network-vif-unplugged", "status": "completed", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:28.779979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-4c2e9c9e-13ee-4d48-90dd-d91ebe620423 req-74f35da8-b126-44a1-86df-1727c0f6ebc0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.781012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-4c2e9c9e-13ee-4d48-90dd-d91ebe620423 req-74f35da8-b126-44a1-86df-1727c0f6ebc0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.792620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:28.809481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-4c2e9c9e-13ee-4d48-90dd-d91ebe620423 req-74f35da8-b126-44a1-86df-1727c0f6ebc0 service nova] Creating event network-vif-unplugged:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:09:28.812143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b37e7370-d021-4cd0-a752-6c7a54bcb528 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.193468 May 30 12:09:28.818436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 216/424] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:28 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:28.825624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-4c2e9c9e-13ee-4d48-90dd-d91ebe620423 req-74f35da8-b126-44a1-86df-1727c0f6ebc0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064394 May 30 12:09:28.826338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 209/425] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:09:28.902809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:28.903752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:28.911060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.911641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:28.912662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:28.913296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.064928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:29.072771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f8d13025-96f1-4dd6-8865-63899c81128c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.174037 May 30 12:09:29.073338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 217/426] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:28 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:29.387282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:29.388016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:29.394811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.395315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.396158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.396602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.529539 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:29.538034 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:29.539601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:29.540770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-384f2027-e3ac-450f-bfe1-5657cfca9fd3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1664 microversion: 2.20 time: 0.158079 May 30 12:09:29.541334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 210/427] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:29 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:29.559018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dee1d403-7d9e-41f2-8732-c666c60f55cd"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:29.560357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:29.566886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.567492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.569286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.569638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.781039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:29.830878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:29.831755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:29.838467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.838921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.842763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:29.842763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:29.897498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c1758904-5b0e-4902-8f79-72f6f526c116 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341898 May 30 12:09:29.899093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 218/428] 10.222.0.41 () {62 vars in 1363 bytes} [Mon May 30 12:09:29 2022] POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments => generated 188 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 30 12:09:30.015369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.022322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:30.023192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:30.024819 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6042bf3a-e3df-436d-a5e9-384523b755d6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.198262 May 30 12:09:30.025546 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 211/429] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:29 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:30.029539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.030001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.030806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.031269 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.089833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:30.090933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:30.097681 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.098439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.099452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.100155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.138968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b44cd2dc-68af-4b62-8b30-bdeba60f8418 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/action" status: 202 len: 0 microversion: 2.20 time: 0.120312 May 30 12:09:30.140369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 219/430] 10.222.0.41 () {62 vars in 1318 bytes} [Mon May 30 12:09:30 2022] POST /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 30 12:09:30.155897 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:30.156522 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:30.165329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.165910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.166773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:30.167292 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:30.323309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.335581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.337130 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.338337 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-026ec6c8-87e5-4c02-8c85-0b51979f5307 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1750 microversion: 2.20 time: 0.186763 May 30 12:09:30.339600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 220/431] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:30 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:30.369264 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:30.378069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-662b14e5-b440-4934-95fa-41645d4afd5b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.291897 May 30 12:09:30.378927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 212/432] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:30 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:31.043282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:31.044137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:31.052633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.053525 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.055739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.056300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.218904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.227135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-589d810f-3a50-4400-a51c-29f67a932123 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.187955 May 30 12:09:31.227721 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 221/433] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:31 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:31.357728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:31.358627 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:31.365898 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.366390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.367179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.367617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.396828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:31.397843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:31.405074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.405729 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.406492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:31.407085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:31.545255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.569464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.570917 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.572163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3c25e4f5-ad34-4fb2-b567-4739a77e95e8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1750 microversion: 2.20 time: 0.218540 May 30 12:09:31.584568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 213/434] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:31 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:31.605963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:31.615112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1870d17f-f42c-4ecd-b55d-afac5ba2d2ce tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.222906 May 30 12:09:31.615906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 222/435] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:31 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:32.245826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.246099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:32.254494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.255447 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.256535 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.257171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.456167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:32.465431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-91b01c92-8437-4779-9f6c-850ebe852113 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.224192 May 30 12:09:32.465991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 214/436] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:32 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:32.590995 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.591644 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:32.610608 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.611971 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.613043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.613694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.633040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:32.633803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:32.641978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.644063 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.645036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:32.649469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:32.844250 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:32.852791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f9b35290-98e8-45ef-b0ee-5d8a34ceb8d3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.223533 May 30 12:09:32.853371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 215/437] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:32 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:32.895481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:32.905140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:32.906960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:32.909017 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3c9e50d7-cfb6-42b2-ad77-6fea12360486 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1752 microversion: 2.20 time: 0.321993 May 30 12:09:32.909611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 223/438] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:32 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1752 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:33.483064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:33.483799 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:33.491117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.491572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.492373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.492811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.705438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:33.722644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b7fc3afe-3fcb-43ce-86fa-dfdfcf313b2e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.243724 May 30 12:09:33.723224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 216/439] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:33 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:33.870886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:33.871567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:33.878152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.878612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.879382 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.879845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.927014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:33.927621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:33.933553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.934000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.934766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:33.935197 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:33.939863 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:34.021512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:34.029283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-344f195c-1a80-4958-a296-7bbc07725218 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.162774 May 30 12:09:34.029845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 224/440] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:33 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:34.129125 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:34.137551 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:34.139105 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:34.140296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-153640eb-7b27-4b23-a0c2-b277a5e83fe3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.217733 May 30 12:09:34.140856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 217/441] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:33 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:34.743024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:34.744778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:34.749208 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1993480580", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "networks": [{"uuid": "745efbf4-510e-4a77-9f91-b1d957f4108c"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:34.754022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:34.755266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:34.756296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:34.756788 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:34.909843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:34.931969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c6f32a27-cac3-49ee-98a6-0a870dec0a22 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.195249 May 30 12:09:34.932842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 225/442] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:34 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:35.046394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:35.047078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:35.054278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.054751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.055620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.056076 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.222132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:35.234474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1383b9e1-4d1d-41ed-a592-0de19d7c8413 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.187887 May 30 12:09:35.235585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 226/443] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:35 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:35.249005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:35.249749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:35.256429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.257161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.258164 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.258796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.473199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:35.482624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:35.484154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:35.485386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bdcbc85f-e59e-4011-addf-6816d1c7af1c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.248624 May 30 12:09:35.486068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 227/444] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:35 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:35.948799 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:35.950200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:35.957657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.958104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:35.958885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:35.959321 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.102149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.111081 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ee585f44-044a-4c31-b32f-6fb3c02ffe94 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.166133 May 30 12:09:36.111658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 228/445] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:35 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:36.252260 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:36.253393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:36.259803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.260291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.261064 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.261510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.410052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.417510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6756c9bc-02f3-4433-ae9c-cd505b454768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.169146 May 30 12:09:36.418087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 229/446] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:36 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:36.506397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:36.507040 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:36.513580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.514028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.514813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:36.515247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:36.651624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.660977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.662514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:36.664437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2fddcaac-bd91-4a73-aeed-872bb528e08c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.162558 May 30 12:09:36.674565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 230/447] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:36 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:37.131773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:37.132494 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:37.139388 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.139844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.140632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.141059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.286099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.296024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-46564180-2a33-4df2-ba79-fa95d7723ca6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.170497 May 30 12:09:37.296805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 231/448] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:37 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:37.435176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:37.436674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:37.444890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.445353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.446146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.446641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.597377 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.604794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d980dbe9-6c03-428c-a578-57d92549d613 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.173967 May 30 12:09:37.605364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 232/449] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:37 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:37.682504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:37.683115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:37.690625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.691023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.691786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:37.692262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:37.706786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SELECT=94 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:37.842708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.851727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.853364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:37.854769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-854a328d-e475-4dfa-979b-4b32f0f9067e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.176172 May 30 12:09:37.855420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 233/450] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:37 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:38.317073 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:38.317836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:38.324953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.325405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.326189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.326935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.472252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:38.480448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5a8a659d-9e80-4a72-8b02-37c4723f8845 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.168073 May 30 12:09:38.481014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 234/451] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:38 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:38.623122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:38.624008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:38.625986 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=98 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:38.640010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.640473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.641440 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.642175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.783137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:38.791719 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0310ac6a-1366-4882-8a3e-00993c481222 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.173131 May 30 12:09:38.792435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 235/452] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:38 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:38.874057 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:38.874812 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:38.882282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.882844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:38.883775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:38.884241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.032062 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.041139 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.042620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.043758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8b7f8860-7dea-4e27-bb93-6606c9aa0caf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.174130 May 30 12:09:39.044335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 236/453] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:38 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:39.498224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:39.498976 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:39.506287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:39.506751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.507612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:39.508085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.664381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.672880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bde7e738-506b-40ce-8828-854475ab4185 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.178504 May 30 12:09:39.673469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 237/454] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:39 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:39.809778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:39.810548 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:39.818748 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:39.823507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.824667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:39.825216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:39.977205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:39.991655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c7d0b074-b395-4090-8e2a-8decc4af2524 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.186478 May 30 12:09:39.992303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 238/455] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:39 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:40.062681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:40.063283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:40.069346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.069795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.070557 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.070991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.231561 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:40.242633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:40.244278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:40.245442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-82f83dc1-6d0f-4436-82b4-10bff11ac037 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.186864 May 30 12:09:40.246178 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 239/456] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:40 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:40.555856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] validate_networks() for [('745efbf4-510e-4a77-9f91-b1d957f4108c', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:09:40.692991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:40.693622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:40.700906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.701365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.702151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.702592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.859538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:40.868394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ad57e20a-f001-4de4-9026-1c905cdc3029 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.180723 May 30 12:09:40.878343 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 240/457] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:40 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:40.929458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:09:40.930056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:09:40.930688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:09:40.931274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:09:40.931868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:09:40.941978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.942683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.943655 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:40.944332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:40.962062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Getting quotas for project 4d363027ab254adfb4ba1b13de71d7e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:09:40.966266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Getting quotas for user dbe77e4880a44d259fac8dfa05722f18 and project 4d363027ab254adfb4ba1b13de71d7e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:09:40.977729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:09:40.980660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:09:41.010259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:41.010972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.019007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.019567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.020483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.026982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.031489 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b48f2a0c-ae84-431a-8201-2c4ecbf5ab76 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.286345 May 30 12:09:41.032389 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 218/458] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:09:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 6288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:09:41.053010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-18b43fc6-721c-4c75-8f35-d2b2eaa5bf68 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:41.053646 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-18b43fc6-721c-4c75-8f35-d2b2eaa5bf68 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.140325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-18b43fc6-721c-4c75-8f35-d2b2eaa5bf68 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.150862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-18b43fc6-721c-4c75-8f35-d2b2eaa5bf68 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1219 microversion: 2.1 time: 0.106412 May 30 12:09:41.152221 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 219/459] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:41 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:41.265126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:41.265877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.272851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.273319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.274216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.274654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.278769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.287869 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bed39498-b166-4d87-a2d5-af6d231b3607 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.281715 May 30 12:09:41.297283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 241/460] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:41 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:41.448710 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.457844 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.459364 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:41.460560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-464ad52d-0433-436c-ba21-6e73813cb7e0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.200002 May 30 12:09:41.461260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 220/461] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:41 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:41.887989 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:41.888631 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:41.896131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.896581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:41.897537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:41.897972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.033470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.042114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-869c5626-1e87-4788-87bb-8eafa41bf7eb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.159155 May 30 12:09:42.042693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 242/462] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:41 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:42.168866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:42.169488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:42.177208 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.177660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.178495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.178934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.257886 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.266490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8da9b15e-5e91-4269-9d8f-8628c461bb64 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1223 microversion: 2.1 time: 0.101388 May 30 12:09:42.267251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 221/463] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:42 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1223 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:42.306266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:42.306874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:42.312896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.313347 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.314109 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.314539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.453183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.461007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-27b473c6-2070-47b8-a0ba-3b94cc18799d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.159052 May 30 12:09:42.461576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 243/464] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:42 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:42.478423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:42.479456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:42.486557 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.487716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.488691 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:42.489472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:42.623970 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.632598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.634103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:42.635265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-674e9e13-b767-494e-8ba7-a97365db7c52 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.160779 May 30 12:09:42.636026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 222/465] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:42 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:43.059665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.060384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.068445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.069212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.070047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.070546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.214381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.226798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f93dbc14-9661-41e5-9cca-4316c98f014a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.170926 May 30 12:09:43.227483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 244/466] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:43.282498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.283274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.290466 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.290914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.291685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.292150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.357871 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.365569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-97720b73-b08c-4355-8cf0-06b3cecc91e2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1223 microversion: 2.1 time: 0.086851 May 30 12:09:43.366395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 223/467] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:43.478827 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.479523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.487507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.487970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.488754 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.489191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.627369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.635576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-498ec597-b301-4c43-a0f7-1aa45e81173d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.161266 May 30 12:09:43.636209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 245/468] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:43.654400 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:43.655001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:43.661795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.662260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.663041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:43.663556 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:43.803649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.812110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.813622 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:43.814803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-84375285-e821-44a0-a39c-880924d754c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.164367 May 30 12:09:43.815505 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 224/469] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:43 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:44.244584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.245811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.252454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.252911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.253682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.254120 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.383177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.383784 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.390453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.390894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.391667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.392113 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.399004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.408171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e4f34f6e-411d-462f-8a84-b1be7fa4c9f4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.167175 May 30 12:09:44.420011 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 246/470] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:44.458338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.465729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-06a78d58-aefc-4a25-b110-fbd4efe24a1e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1223 microversion: 2.1 time: 0.086421 May 30 12:09:44.466289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 225/471] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:44.652438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.653168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.659316 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.659776 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.660576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.661021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.795854 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.804155 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-72cee30a-b5cd-4164-88a8-1a4160ed34ff tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.155491 May 30 12:09:44.804737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 247/472] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:44.832837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:44.833471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:44.839520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.840018 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.840784 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:44.841220 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:44.986398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:44.999596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.001124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.002342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-134874da-fb1f-4cd2-bb45-957b3ceb0aac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.173372 May 30 12:09:45.003982 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 226/473] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:44 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:45.426498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:45.427107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:45.433738 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.434190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.434956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.435393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.483039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:45.483592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:45.490255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.490774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.491761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.492143 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.581819 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.591237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-de9fb8c5-1243-45d7-8724-8cc221677bac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1223 microversion: 2.1 time: 0.112232 May 30 12:09:45.592043 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 227/474] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:45 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1223 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:45.593431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.602041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-59b08ae6-1111-45a0-becc-397f7a3117ac tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.179645 May 30 12:09:45.602624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 248/475] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:45 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:45.821035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:45.821644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:45.827927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.828381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.829157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:45.829597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:45.963847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:45.971499 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2448e0ce-01c5-499a-9588-dd67c69ccc5d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.154035 May 30 12:09:45.972052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 228/476] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:45 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:46.022283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.022896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.029006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.029381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.030145 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.030583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.161112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.169847 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.171383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.172582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-027f26fb-c0a0-485b-af50-ca1d30766d6f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.154869 May 30 12:09:46.173149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 249/477] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:46.608994 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.609607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.616614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.617065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.617827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.618266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.620169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.620790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.627154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.628307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.629086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.629522 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.632213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:46.680513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.688464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-055d20c3-54b9-442b-b418-93629692b2ae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1223 microversion: 2.1 time: 0.083539 May 30 12:09:46.689022 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 229/478] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:46.765211 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:46.773405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-38f4d58d-b218-458e-9e86-74a0f65858fb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1725 microversion: 2.1 time: 0.157126 May 30 12:09:46.773987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 250/479] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:46.989336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:46.989977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:46.996201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.996656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:46.997425 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:46.997872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.132473 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.139911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da114314-38a0-4bbf-90cd-caae99485896 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.155349 May 30 12:09:47.140478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 230/480] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:46 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:47.191436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:47.192126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:47.198506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.198957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.199706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.200183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.354720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.364086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.365687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.366895 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-97db0135-ad4d-4fa2-a455-eaf655e1d95c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.179793 May 30 12:09:47.367475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 251/481] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:47 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:47.626934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1413985122", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261961072", "security_groups": [{"name": "tempest-secgroup-smoke-784746195"}], "block_device_mapping_v2": [{"uuid": "44f57024-cae0-4d37-82fc-e27b4e52635f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc16439-b142-4833-aa53-bbb0e6914ce9"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:47.706401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:47.707137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:47.715193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.715765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.716892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.717705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.748281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] validate_networks() for [('acc16439-b142-4833-aa53-bbb0e6914ce9', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:09:47.788833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.796550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1bac7b05-6f63-40b9-adb8-b96abbbdd908 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1215 microversion: 2.1 time: 0.094227 May 30 12:09:47.797146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 252/482] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:47 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1215 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:47.802666 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:47.803289 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:47.809667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.810115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.810882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.811318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:47.952126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:47.960672 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c31e37cb-f4f5-40ea-9922-c5c9b67dce26 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1702 microversion: 2.1 time: 0.162480 May 30 12:09:47.961262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 253/483] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:47 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1702 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:47.977188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-de9c7f31-b9fb-4757-984f-d141571652b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:47.983633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de9c7f31-b9fb-4757-984f-d141571652b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:47.984113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de9c7f31-b9fb-4757-984f-d141571652b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.044323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-de9c7f31-b9fb-4757-984f-d141571652b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Going to try to start instance {{(pid=117705) start /opt/stack/nova/nova/compute/api.py:2730}} May 30 12:09:48.088041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-de9c7f31-b9fb-4757-984f-d141571652b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action" status: 202 len: 0 microversion: 2.1 time: 0.114568 May 30 12:09:48.088660 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 254/484] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:09:47 2022] POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:09:48.096907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.097596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.104804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.105323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.106110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.106792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.240671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.248566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cada7564-a180-4150-9c76-c7064dc96021 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.155733 May 30 12:09:48.249139 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 255/485] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:48.253713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.254466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.260262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.260713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.261486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.261922 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.366251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:09:48.366683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:09:48.367305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:09:48.368028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:09:48.368445 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:09:48.377758 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.378224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.379036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.379475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.392217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.400792 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:09:48.401035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-514de9c7-b147-4cac-a34c-bc1106ad21ba tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.150654 May 30 12:09:48.401732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 256/486] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:48.405282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for user f7e7ce32b4c0457196c8765d6c5ada7e and project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:09:48.406866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.407480 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.414880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.415323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.416108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.416558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.481206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:09:48.484786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44f57024-cae0-4d37-82fc-e27b4e52635f',volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:09:48.567210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.575661 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.577314 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.578630 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4bf3428f-ff02-4dec-a3cf-85927aa3179b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.175695 May 30 12:09:48.579371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 257/487] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:48.629071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-122ddf97-cfe7-463b-99c5-3cfb187bbfe8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.005779 May 30 12:09:48.634565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 231/488] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:09:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:09:48.645029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d34b026c-1ff6-48ef-9d99-c105c269da5b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.645741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d34b026c-1ff6-48ef-9d99-c105c269da5b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.699974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d34b026c-1ff6-48ef-9d99-c105c269da5b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.707507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d34b026c-1ff6-48ef-9d99-c105c269da5b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1094 microversion: 2.1 time: 0.069107 May 30 12:09:48.708419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 258/489] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:48.815344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:48.816188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:48.822566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.823194 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.824294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:48.824829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:48.894643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:48.904372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3d8fc99d-b18d-4479-9321-b2090ce64ecb tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1271 microversion: 2.1 time: 0.093718 May 30 12:09:48.904952 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 232/490] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:48 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:49.266023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.266635 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.273858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.274305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.275066 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.275499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.403300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.411366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ab542cf6-4feb-430b-a8f9-f36cc1e9401b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.149172 May 30 12:09:49.411958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 259/491] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:49.418497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.419121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.426089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.426546 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.427312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.427756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.555320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.562837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ec18f876-0884-4b4a-96aa-e907390df760 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.148417 May 30 12:09:49.563408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 233/492] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:49.597907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.598510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.604682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.605131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.605890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.606323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.730016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.730644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.740395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.744713 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.746133 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.751918 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.754585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.772450 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.774645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.776060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ae3cfb8e-d70f-4dc7-b15c-536c7f96eb9a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.182089 May 30 12:09:49.786115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 260/493] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:49.835801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.843599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5f356787-14ae-40e3-8022-e5899fcc12f8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1144 microversion: 2.1 time: 0.123083 May 30 12:09:49.844203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 234/494] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1144 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:49.921167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:49.921778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:49.928611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.929056 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.929828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:49.930256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:49.991770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:49.999079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3dbc75fa-771f-450b-b3a5-4434bdcc8177 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1271 microversion: 2.1 time: 0.081822 May 30 12:09:49.999643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 261/495] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:49 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:50.428967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:50.429584 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:50.436056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.436513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.437284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.437730 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.567594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.575580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-597ab053-98d6-48f5-b01d-90ebe624721e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.150527 May 30 12:09:50.576166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 235/496] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:50 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:50.580215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:50.581414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:50.588044 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.588491 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.589249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.589707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.736243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.743919 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-baa08f11-f45e-4421-9df4-39946df4c6ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.167585 May 30 12:09:50.744498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 262/497] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:50 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:50.794615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:50.795265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:50.801942 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.802391 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.803179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.803620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.807565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:50.860597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:50.861373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:50.868198 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.868646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.869408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:50.869839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:50.931952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:50.939262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3600f111-1bd0-4b9d-b7ec-4a712fd5ab2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1192 microversion: 2.1 time: 0.082729 May 30 12:09:50.940028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 263/498] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:50 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:51.016020 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:51.016638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.023482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.023972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.024427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.025228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.025667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.035790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.043397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.044889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f19baef7-b1b1-4e72-86c5-f90a22c328fc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.254185 May 30 12:09:51.047369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 236/499] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:50 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:51.134511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.147771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-66ce44ce-078a-40f6-9287-945a79c68fa0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1277 microversion: 2.1 time: 0.135604 May 30 12:09:51.159922 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 264/500] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:51 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1277 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:51.594346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:51.594958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.601099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.601549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.602310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.602744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.739579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.747894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7b81cc1f-816c-4f22-a52f-cf3adbec5cce tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.157345 May 30 12:09:51.748469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 237/501] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:51 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:51.761802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:51.762466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.782476 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.782956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.784105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.784545 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.932970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:51.941376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7886374f-3421-4402-b2b3-6dc1c6a8425d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1500 microversion: 2.1 time: 0.183938 May 30 12:09:51.941981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 265/502] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:51 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1500 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:51.956740 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:51.957947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.958953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81658bea-49ff-4681-a2d8-506cff3bbea4"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:51.960439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:51.964763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.965216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.966020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.966455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.966777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.967228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.968027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:51.968466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:51.994568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] HTTP exception thrown: Cannot 'attach_volume' instance d2484e75-927b-450d-9638-6e57fc7f7e32 while it is in vm_state rescued May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Request method failure captured: May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/os-volume_attachments HTTP/1.1 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 74 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLOqXvhA33OE1KrBTW29-s8ZbGSa1aiF5pPu7DktUZ8_LbOI8Hn39-63aJdT9T9Ti28M4ay4x8coWhLWv89kBE0drMQGK5EzKVXQW45ir05Vyg4gUAAyZTN1FVBtRrV9bpM4-uYWindjSO-QiB5lXo4q9ogifQu6r8SICRlViZdBsEQ May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:09:51.996570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_66312b3f3f73477cbe27defa317537a4", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 4e875190d9dc48edb929bb316d5e576e May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {"volumeAttachment": {"volumeId": "81658bea-49ff-4681-a2d8-506cff3bbea4"}} May 30 12:09:51.998169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Cannot 'attach_volume' instance d2484e75-927b-450d-9638-6e57fc7f7e32 while it is in vm_state rescued May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'server_id': 'd2484e75-927b-450d-9638-6e57fc7f7e32', 'body': {'volumeAttachment': {'volumeId': '81658bea-49ff-4681-a2d8-506cff3bbea4'}}} May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:09:51.999033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d2484e75-927b-450d-9638-6e57fc7f7e32 while it is in vm_state rescued May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:09:52.000264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d2484e75-927b-450d-9638-6e57fc7f7e32 while it is in vm_state rescued May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Returning 409 to user: Cannot 'attach_volume' instance d2484e75-927b-450d-9638-6e57fc7f7e32 while it is in vm_state rescued {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d003b96d-79bf-424e-b889-5f7e6eee7fb9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043971 May 30 12:09:52.004201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 266/503] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:09:51 2022] POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 30 12:09:52.007182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:52.007714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:52.013871 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.014325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.015085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.015528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.020289 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:52.073563 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.082598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-69e66a09-a677-4926-b77c-b163ea4ae846 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1200 microversion: 2.1 time: 0.129871 May 30 12:09:52.092592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 238/504] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:51 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1200 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:52.092592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:52.092592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:52.094252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-477fa8f7-f18a-44e4-bd96-016e4fbb8bd3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/action" status: 202 len: 0 microversion: 2.1 time: 0.090473 May 30 12:09:52.094647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.095225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 267/505] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:09:52 2022] POST /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:09:52.095349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.095864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.096993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.103520 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:52.104376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:52.110997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.111752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.112607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.113144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.246892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.255053 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9db7c18c-ce68-46f5-bd58-4864ea16f2cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.155538 May 30 12:09:52.255623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 268/506] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:52 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:52.260265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:52.261151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:52.266860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.267302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.268799 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.269235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.283967 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.292803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.294351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.295528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6acabaaf-4d49-43ed-95b8-bfd7244576f7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.210974 May 30 12:09:52.307259 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 239/507] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:52 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:52.406185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.414466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c61ec863-2ea7-418e-8c22-75878af089c8 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.157826 May 30 12:09:52.415064 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 269/508] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:52 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:52.604753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-689ef089-a45a-4a07-b9d4-ce89809e938b req-466f557e-9d8b-4976-918c-cb76bec13fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43ef40cb-34ac-461b-a737-8a21131602c6", "tag": "c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:52.613714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-689ef089-a45a-4a07-b9d4-ce89809e938b req-466f557e-9d8b-4976-918c-cb76bec13fea service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.614165 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-689ef089-a45a-4a07-b9d4-ce89809e938b req-466f557e-9d8b-4976-918c-cb76bec13fea service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.629214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-689ef089-a45a-4a07-b9d4-ce89809e938b req-466f557e-9d8b-4976-918c-cb76bec13fea service nova] Creating event network-changed:c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7 for instance 43ef40cb-34ac-461b-a737-8a21131602c6 on hv-cinder-83979 May 30 12:09:52.634497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-689ef089-a45a-4a07-b9d4-ce89809e938b req-466f557e-9d8b-4976-918c-cb76bec13fea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034136 May 30 12:09:52.635102 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 240/509] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:52.769171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:52.769171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:52.775349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.776149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.777120 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:52.777629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:52.944052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:52.956642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dc611ffb-8308-4617-8c1c-6920ee8b719d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.194690 May 30 12:09:52.957992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 270/510] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:52 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:53.100161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.100862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.107678 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.108172 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.108942 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.109387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.218529 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.226392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-906c2f27-342f-4353-ad01-d10a3bee892f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1210 microversion: 2.1 time: 0.130427 May 30 12:09:53.227906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 241/511] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1210 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:53.273772 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.274395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.281166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.281625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.282411 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.282843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.315724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.316379 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.318404 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:53.323803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.324299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.325088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.325532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.466696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.475930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.477437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.478644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-837ba9c5-cca6-44fd-91cb-78e7f4f2378e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.167510 May 30 12:09:53.479219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 242/512] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:53.483937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.484555 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.491642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.492130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.492906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.493348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.623708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.632126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-72a29fc3-92d5-4aad-ba6a-cfd1e9001e97 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.151863 May 30 12:09:53.632807 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 243/513] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:53.689662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:53.697100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4fe1f9c9-3c86-4f1a-a776-80f799484265 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.428353 May 30 12:09:53.697668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 271/514] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:53.976311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:53.977313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:53.986662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.987460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:53.988433 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:53.988977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.207981 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.216078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-92e08c22-3fb1-448f-9f9f-1c8ebc122308 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.245445 May 30 12:09:54.216653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 244/515] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:53 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:54.243939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:54.244640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:54.250659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.251203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.252640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.253637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.319399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.326874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e8504400-327a-47ce-9975-80e0b4c9b7da tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1210 microversion: 2.1 time: 0.086798 May 30 12:09:54.327450 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 272/516] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:54 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:54.497871 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:54.498561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:54.505915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.506462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.507328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.508089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.641766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.649161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:54.649775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:54.651174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.652708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.653867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-efd45590-f061-4dfb-b065-4824f23cda48 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.160063 May 30 12:09:54.654723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 245/517] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:54 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:54.656671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.657130 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.657953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.658479 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.714551 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:54.715121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:54.721122 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.721568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.722330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:54.722763 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:54.790096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.797681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5b2c8188-1971-4f20-a8b4-98ba917a17e5 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.152572 May 30 12:09:54.798263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 273/518] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:54 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:54.855855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:54.864157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4bc63411-dacf-4a6f-8859-ea8f4b0196e8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.153498 May 30 12:09:54.864726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 246/519] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:54 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:55.233302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.233917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.240107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.240559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.241320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.241759 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.349770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.351216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.363242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.364244 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.367422 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.369297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.451517 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.460065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-346b1c12-1a4d-40f3-963f-b2dbbfd04f04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1711 microversion: 2.1 time: 0.230769 May 30 12:09:55.460641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 274/520] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1711 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:55.619405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.626855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ba27b682-a08b-4c90-aae7-4e68cb559b3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1277 microversion: 2.1 time: 0.286049 May 30 12:09:55.627986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 247/521] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:55.671264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.671895 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.678451 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.678892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.679651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.680110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.815109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.815855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.822221 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.822737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.822977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.823667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.824216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.835519 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.837872 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:55.839291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d67a163f-07df-4bb3-a975-d7b8a35f86c0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.171838 May 30 12:09:55.851787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 275/522] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:55.881773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:55.882377 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:55.888993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.889450 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:55.890238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:55.890688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.047075 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.057645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d4b56336-ab55-43ae-a8c5-98405dd77afa tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.179646 May 30 12:09:56.058516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 276/523] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:56.296912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.304775 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2be20aca-11ed-4f01-a8b1-428e3842a2e0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.493869 May 30 12:09:56.305345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 248/524] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:55 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:56.453539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-46d96ff5-c0de-432f-8b7f-45a53c0ecbb1 req-ce4c81c2-c2f9-4e64-b36a-26976d94b2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b", "tag": "362343d9-e05b-46da-9e7b-f85cbc6ae1a1"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:56.466785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-46d96ff5-c0de-432f-8b7f-45a53c0ecbb1 req-ce4c81c2-c2f9-4e64-b36a-26976d94b2a4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.467645 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-46d96ff5-c0de-432f-8b7f-45a53c0ecbb1 req-ce4c81c2-c2f9-4e64-b36a-26976d94b2a4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.481215 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:56.483024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:56.490390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-46d96ff5-c0de-432f-8b7f-45a53c0ecbb1 req-ce4c81c2-c2f9-4e64-b36a-26976d94b2a4 service nova] Creating event network-changed:362343d9-e05b-46da-9e7b-f85cbc6ae1a1 for instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b on hv-cinder-83979 May 30 12:09:56.496487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-46d96ff5-c0de-432f-8b7f-45a53c0ecbb1 req-ce4c81c2-c2f9-4e64-b36a-26976d94b2a4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047626 May 30 12:09:56.497629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 277/525] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:56.498071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.498945 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.500375 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.500991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.646385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:56.647437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:56.662903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.665813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.667381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.668074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.789679 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.797733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-64a9b1bc-a4b8-47e4-bde4-f47b3bccd47c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1715 microversion: 2.1 time: 0.323958 May 30 12:09:56.798408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 249/526] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:56 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1715 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:56.834020 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:56.841400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5af54483-380c-4a7b-a1bd-fd569628b96f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.200486 May 30 12:09:56.841969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 278/527] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:56 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:09:56.858400 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:56.858937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:56.865261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.865704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:56.866633 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:56.867066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.000516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:57.009577 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:57.011074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:57.012387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-80cf6842-8f98-4511-9ec0-c7ca672ae7d1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.158266 May 30 12:09:57.017406 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 250/528] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:56 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:57.075550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:57.076464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:57.084113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.084581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.085413 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.085857 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.285935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:57.293517 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6e1bd374-d979-41bf-b482-d1d49ed68a8d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.222796 May 30 12:09:57.294191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 279/529] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:57 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:57.321455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:57.322068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:57.328279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.328766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.329529 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.329999 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.462753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:57.470439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-31824b53-7c11-43fe-a4e6-dc775b77eb8a tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.152769 May 30 12:09:57.471547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 251/530] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:57 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:57.859485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:57.860126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:57.867357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.867807 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:57.868600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:57.869038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.001554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.009126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e01d0467-40cd-44b9-8ee5-cae529f825e2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.153805 May 30 12:09:58.009701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 280/531] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:57 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:58.031978 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:58.032524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:58.038935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.039386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.040177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.040614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.167454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.176596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.178110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.179272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c02401ec-cb65-4508-a717-1803176c43cb tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.151201 May 30 12:09:58.179855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 252/532] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:58 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:09:58.311173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:58.311713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:58.318253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.318703 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.319471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.319941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.444743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.452108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b7406c34-9eb6-46fa-b841-0d7962f3a358 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.144759 May 30 12:09:58.452679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 281/533] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:58 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:58.488157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:58.488878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:58.491179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=4 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:58.492057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=14 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:58.497618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.498069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.498838 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:58.499276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:58.513748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:58.632150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:58.639685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7dda87f1-be20-4dda-ab6b-43a9e38c18b4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.155423 May 30 12:09:58.640320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 253/534] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:58 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:59.016820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-5c6b0a15-a36a-41e7-bc12-ae4eebb4c431 req-93e8eec1-e7ac-4e35-b2af-174535b27035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "name": "network-vif-plugged", "status": "completed", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:09:59.021669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:59.026056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:59.026800 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:59.029598 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-5c6b0a15-a36a-41e7-bc12-ae4eebb4c431 req-93e8eec1-e7ac-4e35-b2af-174535b27035 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.030132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-5c6b0a15-a36a-41e7-bc12-ae4eebb4c431 req-93e8eec1-e7ac-4e35-b2af-174535b27035 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.034098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.035657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.037016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.037615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.042431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-5c6b0a15-a36a-41e7-bc12-ae4eebb4c431 req-93e8eec1-e7ac-4e35-b2af-174535b27035 service nova] Creating event network-vif-plugged:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:09:59.047369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-5c6b0a15-a36a-41e7-bc12-ae4eebb4c431 req-93e8eec1-e7ac-4e35-b2af-174535b27035 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034328 May 30 12:09:59.047988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 282/535] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:09:59.169856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.177873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-34c56187-be42-497c-89e2-a5cbe20e9eb0 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.155803 May 30 12:09:59.178438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 254/536] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:59 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:59.197758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:59.198474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:59.204597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.205114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.205902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.206328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.336187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.345013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.346643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.347887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-54e0ae07-bf0d-4bf6-bb86-de5d64988fcd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.154254 May 30 12:09:59.348438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 283/537] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:09:59 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:09:59.469538 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:59.470158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:59.476737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.477191 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.477957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.478399 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.612224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.619616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bb37a647-8876-4c40-84f5-de0dd32575e9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1508 microversion: 2.1 time: 0.153912 May 30 12:09:59.620206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 255/538] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:59 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:09:59.656821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:09:59.657454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:09:59.660507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:59.665744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.666187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.666932 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:09:59.667363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:09:59.671356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:09:59.796449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:09:59.804405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e895f080-308c-4e22-8e59-c795f097db2f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.151376 May 30 12:09:59.804970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 284/539] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:09:59 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:00.194863 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:00.195474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:00.201406 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.201856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.202620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.203058 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.332195 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.339484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b7f30cf4-fb26-47e9-9cfc-c2265ad6b81b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.148485 May 30 12:10:00.340071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 256/540] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:00 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:00.366236 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:00.366847 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:00.373360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.373806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.374568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.375009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.506122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.514427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.515966 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.517132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3002f178-49e8-4bea-830d-9dabe5d06243 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.154861 May 30 12:10:00.518357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 285/541] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:10:00 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:10:00.636494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:00.636993 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:00.643858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.644312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.645092 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.645532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.791278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.800155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9560e88d-7fb3-4757-95b6-ae6887d8d770 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1514 microversion: 2.1 time: 0.166274 May 30 12:10:00.800735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 257/542] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:00 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:00.821309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:00.821924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:00.827968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.828516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.829157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:00.829589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:00.971036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:00.978834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2c8b3ccb-6469-43de-bd39-03bac124f00b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.161348 May 30 12:10:00.979790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 286/543] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:00 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:01.358286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:01.359158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:01.366609 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.367056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.368022 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.368767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.515422 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.523867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1be977c3-ad02-4e28-b069-ccd45e51945d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.170983 May 30 12:10:01.524462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 258/544] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:01 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:01.537862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:01.538633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:01.545100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.545545 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.546339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:01.546795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:01.690863 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.699435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.700984 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:01.702144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bde19565-392a-4b23-b287-28e895e59856 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.169582 May 30 12:10:01.702711 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 287/545] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:10:01 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:01.997372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:01.997985 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:02.005072 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.005549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.006310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.006746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.165677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.174388 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-427638cc-7044-475e-992b-4825715a2fd2 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.180120 May 30 12:10:02.175027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 259/546] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:01 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:02.204691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-af24a926-2b87-4bd4-86f3-54672b16ef14 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: .version_select at 0x7f61a1c8f3a0>, body: {"keypair": {"name": "tempest-keypair-22730253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIo/+uhvsehTrfk/NJ5umzp9Cc5xu/Rd4E4ayCkcXCPnATgXOJnOec+h+Fpfpa+ku8PrAvEvDDw6zBG2zg5q5oyssAzD5vHss24tDN1C6y1G2Kj1B9SMTQ5JTtP8JiB6A=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:02.219197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-af24a926-2b87-4bd4-86f3-54672b16ef14 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for project 66312b3f3f73477cbe27defa317537a4. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:10:02.223071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-af24a926-2b87-4bd4-86f3-54672b16ef14 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for user 4e875190d9dc48edb929bb316d5e576e and project 66312b3f3f73477cbe27defa317537a4. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:10:02.246208 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-af24a926-2b87-4bd4-86f3-54672b16ef14 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045239 May 30 12:10:02.246810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 288/547] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:10:02 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:02.541739 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:02.542356 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:02.549419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.549708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.550448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.550905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.721708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:02.722253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:02.728628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.729077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.729841 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:02.730274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:02.817094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.830754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-90fde125-c444-4d78-8125-7a154fa8e328 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.291902 May 30 12:10:02.831362 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 260/548] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:02 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:02.876633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.885641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.887245 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:02.888471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-34f7ecbb-9c8b-431a-a0ce-a8126efc0434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.171648 May 30 12:10:02.899770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 289/549] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:10:02 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:03.192320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:03.192964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:03.199498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.199980 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.200756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.201390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.512957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:03.522623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-db0bde73-73ba-41e7-8276-6a5c7623eb22 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.334851 May 30 12:10:03.523202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 261/550] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:03 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:03.848005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:03.848624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:03.855220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.855668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.856739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.857185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.907742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:03.909174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:03.915440 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.916003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:03.916843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:03.917340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.055074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.063739 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-80a0475b-ec10-48bb-b19f-7719f4e43a2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.219606 May 30 12:10:04.064954 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 290/551] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:03 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:04.071322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-484159783", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2b5e847e-ae7c-425e-b52a-485f1649ea1d"}], "security_groups": [{"name": "tempest-securitygroup--675677920"}], "key_name": "tempest-keypair-22730253", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:04.085016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.094914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.097130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.098394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-77f1a1c8-a1fc-4b9c-ad16-e6fb11056333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1808 microversion: 2.20 time: 0.195411 May 30 12:10:04.099032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 262/552] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:10:03 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:04.180596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] validate_networks() for [('2b5e847e-ae7c-425e-b52a-485f1649ea1d', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:10:04.540593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:04.541235 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:04.547710 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.548286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.549179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.549753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.571633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:10:04.572091 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:10:04.572572 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:10:04.572983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:10:04.573393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:10:04.582828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.583284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.584113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:04.584552 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:04.602611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:10:04.606828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Getting quotas for user 4e875190d9dc48edb929bb316d5e576e and project 66312b3f3f73477cbe27defa317537a4. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:10:04.618273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:10:04.620586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:10:04.667972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-947cc98c-fb6b-4d34-81f3-dee979d86b88 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.600569 May 30 12:10:04.668636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 291/553] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:10:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:10:04.678780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c51c29cf-fa55-423b-aa5b-fcee3e39695b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:04.679390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c51c29cf-fa55-423b-aa5b-fcee3e39695b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:04.694745 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.702893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e94e81e3-8666-4187-bd21-97b99894a241 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.166219 May 30 12:10:04.703642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 263/554] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:04 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:04.733744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c51c29cf-fa55-423b-aa5b-fcee3e39695b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:04.741457 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c51c29cf-fa55-423b-aa5b-fcee3e39695b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1243 microversion: 2.1 time: 0.066104 May 30 12:10:04.741832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 292/555] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:04 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1243 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:05.082239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:05.082851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:05.089288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.089754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.090391 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.090823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.117873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:05.119137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:05.127960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.128917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.130186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.130848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.256243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.264902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7bfcd4ef-3fb7-48af-b117-03d3dec819ca tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.186594 May 30 12:10:05.265939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 264/556] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:05 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:05.271482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-f31626c2-5509-45c7-907e-481b16c9cbff req-7468718e-43f7-4035-af1b-f15c00bd0507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ef40cb-34ac-461b-a737-8a21131602c6", "name": "network-vif-plugged", "status": "completed", "tag": "c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:05.282077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-f31626c2-5509-45c7-907e-481b16c9cbff req-7468718e-43f7-4035-af1b-f15c00bd0507 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.282847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-f31626c2-5509-45c7-907e-481b16c9cbff req-7468718e-43f7-4035-af1b-f15c00bd0507 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.297560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-f31626c2-5509-45c7-907e-481b16c9cbff req-7468718e-43f7-4035-af1b-f15c00bd0507 service nova] Creating event network-vif-plugged:c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7 for instance 43ef40cb-34ac-461b-a737-8a21131602c6 on hv-cinder-83979 May 30 12:10:05.299964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.302477 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-f31626c2-5509-45c7-907e-481b16c9cbff req-7468718e-43f7-4035-af1b-f15c00bd0507 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035152 May 30 12:10:05.303081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 265/557] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:05.312764 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.314469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.315637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-96051f88-191e-44c1-b933-c31db61473d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1795 microversion: 2.20 time: 0.202363 May 30 12:10:05.316394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 293/558] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:10:05 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1795 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:10:05.721326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:05.722059 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:05.728222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.728667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.729421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.729857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.758699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:05.759305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:05.766093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.766543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.768042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:05.769043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:05.840995 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.848771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c2b29a22-810d-4837-a300-33de1558e80a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1295 microversion: 2.1 time: 0.093753 May 30 12:10:05.858396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 294/559] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:05 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1295 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:05.872354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:05.880773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ee0e98d9-61b4-4287-8f35-9e4756a4def4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.164614 May 30 12:10:05.881344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 266/560] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:05 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:06.282665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.283948 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.290483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.290936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.291696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.292176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.421639 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:06.429524 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-89f7008f-7461-4245-8867-f57eb12c79ae tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.150817 May 30 12:10:06.430088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 295/561] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:06.866905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.867524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.874435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.874890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.875661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.876128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.899689 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:06.900371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:06.906885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.907343 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.909058 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:06.909562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:06.944796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:06.953202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-15c234c6-960f-40d1-8831-6e9460d23da6 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1301 microversion: 2.1 time: 0.090103 May 30 12:10:06.953778 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 267/562] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:07.043149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:07.052222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5f305bf7-5568-49c3-9c4d-4143934b0c30 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.157196 May 30 12:10:07.053151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 296/563] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:06 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:07.446310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:07.446948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:07.453110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.453557 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.454318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.454845 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.586915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:07.594256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f0315f8e-7324-4204-b16c-156f3abd6082 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.151794 May 30 12:10:07.594812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 268/564] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:07 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:07.970452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:07.971689 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:07.978225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.978675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:07.979435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:07.979903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.044782 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.053227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-04efc0d9-0587-44de-9aa8-7f3ffc559a37 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1301 microversion: 2.1 time: 0.086626 May 30 12:10:08.053836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 297/565] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:07 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:08.069282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:08.069895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:08.076660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.077112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.077882 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.078320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.208512 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.215707 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6ea8e28f-ea0b-448a-bc53-7cafc38ddc88 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1319 microversion: 2.1 time: 0.150173 May 30 12:10:08.216381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 269/566] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:08 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:08.611394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:08.612032 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:08.617997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.618438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.619184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:08.619613 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:08.749173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:08.757157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7e3681b6-a8dc-4cc4-8b18-2c7e401fc098 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.149627 May 30 12:10:08.757726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 298/567] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:08 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:09.070578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:09.071186 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:09.077756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.078200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.078951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.079383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.140830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.143620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=100 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:09.150381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-aa3d55e8-5935-44fc-b973-6f63f820a8cf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1301 microversion: 2.1 time: 0.083533 May 30 12:10:09.151026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 270/568] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:09 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:09.233209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:09.233820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:09.240525 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.240972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.241732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.242163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.621952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.630200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-79937de3-9e26-477d-8fbe-201bfd18a04f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1507 microversion: 2.1 time: 0.401081 May 30 12:10:09.630777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 299/569] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:09 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1507 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:09.774727 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:09.775148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:09.782964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.783500 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.784785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:09.785430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:09.935277 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:09.949710 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6d53d219-d6c6-43f4-b983-5993f7801839 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.178859 May 30 12:10:09.956714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 271/570] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:09 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:10.167643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.168348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.176686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.177359 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.178134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.178756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.453233 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:10.464795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-89ab5937-ff97-4c2a-bf1a-d3aa93515f84 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.300999 May 30 12:10:10.465367 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 300/571] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:10 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:10.903758 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-a91811b4-4b12-48c7-bbc1-ceaff142d776 req-45200261-c7c2-4b1c-9271-50a7304ef151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:10.925868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a91811b4-4b12-48c7-bbc1-ceaff142d776 req-45200261-c7c2-4b1c-9271-50a7304ef151 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.930972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a91811b4-4b12-48c7-bbc1-ceaff142d776 req-45200261-c7c2-4b1c-9271-50a7304ef151 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.947351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-a91811b4-4b12-48c7-bbc1-ceaff142d776 req-45200261-c7c2-4b1c-9271-50a7304ef151 service nova] Creating event network-changed:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:10:10.953937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-a91811b4-4b12-48c7-bbc1-ceaff142d776 req-45200261-c7c2-4b1c-9271-50a7304ef151 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061605 May 30 12:10:10.956329 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 272/572] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:10.966463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:10.967182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:10.974693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.975219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:10.976147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:10.976661 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:11.204475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.215207 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-35076d98-79ce-4c3e-a8c2-5f0799b5c3b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.252544 May 30 12:10:11.215798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 301/573] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:10 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:11.483353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:11.484359 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:11.491403 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:11.491894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:11.492668 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:11.493106 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:11.628954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:11.636632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c62cbf78-fe14-4301-b7a0-747a6068e591 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.157871 May 30 12:10:11.637485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 273/574] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:11 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:12.232792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:12.233409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:12.240458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.240936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.241688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.242116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.375212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.384038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e90bd2dc-22be-4d7b-b48b-e5eed43a947d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.155155 May 30 12:10:12.384625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 302/575] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:12 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:12.653776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:12.654341 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:12.661265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.661735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.662503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:12.662935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:12.797737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:12.806153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-48e2008e-faf4-4d14-977a-c221510e1978 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.156374 May 30 12:10:12.806728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 274/576] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:12 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:13.400518 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:13.401133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:13.408295 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.408767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.409536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.409981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.425229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:13.616434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:13.623837 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-db1e7555-c890-487f-9fc7-7f0155585ffa tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.227156 May 30 12:10:13.624724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 303/577] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:13 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:13.791573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-7930f40a-e278-4fe1-9dbe-43e5e7d25f06 req-8f72702b-0cb7-4820-acb9-8c8c32b098c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b", "name": "network-vif-plugged", "status": "completed", "tag": "362343d9-e05b-46da-9e7b-f85cbc6ae1a1"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:13.801174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-7930f40a-e278-4fe1-9dbe-43e5e7d25f06 req-8f72702b-0cb7-4820-acb9-8c8c32b098c0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.801619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-7930f40a-e278-4fe1-9dbe-43e5e7d25f06 req-8f72702b-0cb7-4820-acb9-8c8c32b098c0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.816283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-7930f40a-e278-4fe1-9dbe-43e5e7d25f06 req-8f72702b-0cb7-4820-acb9-8c8c32b098c0 service nova] Creating event network-vif-plugged:362343d9-e05b-46da-9e7b-f85cbc6ae1a1 for instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b on hv-cinder-83979 May 30 12:10:13.821808 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-7930f40a-e278-4fe1-9dbe-43e5e7d25f06 req-8f72702b-0cb7-4820-acb9-8c8c32b098c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034326 May 30 12:10:13.825295 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:13.826436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:13.826601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 275/578] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:10:13.834950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.835654 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:13.836637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:13.837231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.065229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.072576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1f456f11-6442-4166-8adb-eb631bc87879 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.253170 May 30 12:10:14.073141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 304/579] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:13 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:14.109619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.110476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.117543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.117928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.118857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.119296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.145889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fddcd8df-e0fa-469b-833d-5d5cc1d5e0e3 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/ips" status: 200 len: 151 microversion: 2.1 time: 0.040650 May 30 12:10:14.146462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 276/580] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:10:14 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:14.157418 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9cb29d-20c0-45ea-9cac-ac7e34f2a243"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:14.158647 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.165190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.165640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.166414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.166858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.252469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: POST /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/os-volume_attachments HTTP/1.1 May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 74 May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:10:14.254356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {"volumeAttachment": {"volumeId": "7a9cb29d-20c0-45ea-9cac-ac7e34f2a243"}} May 30 12:10:14.255866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'server_id': 'ea5b29cb-133f-4082-a3f5-5094e70ccb3f', 'body': {'volumeAttachment': {'volumeId': '7a9cb29d-20c0-45ea-9cac-ac7e34f2a243'}}} May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:14.256746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:14.257967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 400 to user: Invalid volume: volume 7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 is already attached to instances: 5505ae9e-14bf-49a2-9e34-b42e866bb86f {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d09f3162-facd-461a-8ea6-cf51ce420a9b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102749 May 30 12:10:14.259099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 305/581] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:10:14 2022] POST /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:10:14.264902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.265405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.271938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.272399 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.273175 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.273621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.302471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:10:14.380873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9943100e-0656-48a3-b1d3-7fb08de66685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 204 len: 0 microversion: 2.1 time: 0.119485 May 30 12:10:14.381374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 277/582] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:10:14 2022] DELETE /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:10:14.390054 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.390859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.397578 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.398028 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.398834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.399273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.530376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.538584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5ba16211-31ff-440d-88e6-7686e6178fe9 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1682 microversion: 2.1 time: 0.152953 May 30 12:10:14.539148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 306/583] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:14 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:14.640773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:14.641389 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:14.647586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.648066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.648824 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:14.649260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:14.787682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:14.795241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-58fd25e2-46e8-4be4-ac5f-af355f16b75d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.158740 May 30 12:10:14.795789 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 278/584] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:14 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:15.090085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:15.090882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:15.092850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:15.093683 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=12 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:15.100001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.100452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.101250 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.101684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.237665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:15.244986 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-445c720f-fac2-4d4c-a81d-0f41c0e12b86 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.159639 May 30 12:10:15.245549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 307/585] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:15 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:15.558158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:15.558750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:15.565559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.566011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.566784 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.567224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.699471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:15.707254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da22bf15-c2e5-4d9c-be7c-921a0caf3fdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1682 microversion: 2.1 time: 0.153286 May 30 12:10:15.707839 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 279/586] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:15 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:15.812598 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:15.813396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:15.821501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.821951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.822720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:15.823155 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:15.958956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:15.966384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2cde021e-8d40-4a5d-be16-5a8563563e41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.158005 May 30 12:10:15.966958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 308/587] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:15 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:16.262616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:16.263227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:16.269920 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.270373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.271137 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.271575 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.403411 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.412106 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4b952cc0-78f6-4f06-ace3-dbf8d834d23f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.153242 May 30 12:10:16.412667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 280/588] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:16 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:16.725078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:16.725695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:16.732138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.732591 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.733352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.733789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.869835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:16.877758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-775de9cf-3d10-4cbc-af21-15e93090c806 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1682 microversion: 2.1 time: 0.157526 May 30 12:10:16.878317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 309/589] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:16 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:16.982961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:16.983568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:16.990206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.990657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:16.991415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:16.991872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.122168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.129841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3d60e6f5-6192-4c4d-bb7e-bfffa8b27b4e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.150998 May 30 12:10:17.130402 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 281/590] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:16 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:17.429169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:17.429778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:17.435823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.436291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.437051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.437482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.569724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:17.577027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d9e6ba77-6270-4019-9fb6-1c81626a311f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.151723 May 30 12:10:17.577583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 310/591] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:17 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:17.894319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:17.894923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:17.901416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.901866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:17.902638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:17.903073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.037123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.044570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c4c2f127-54a8-4e1e-b9c5-193b4e80f312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1682 microversion: 2.1 time: 0.154723 May 30 12:10:18.045139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 282/592] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:17 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:18.146765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:18.147373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:18.153886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.154335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.155090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.155524 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.287154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.294532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cf9f7326-f6d8-401f-b5b2-d7d1740e52c8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1265 microversion: 2.1 time: 0.151668 May 30 12:10:18.295092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 311/593] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:18 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:18.561466 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-a01c01a3-09d4-492e-8a2e-a449044de5de req-790ddc9b-eb61-4eb0-bf34-6ebfd61db3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "name": "network-vif-plugged", "status": "completed", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:18.574163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a01c01a3-09d4-492e-8a2e-a449044de5de req-790ddc9b-eb61-4eb0-bf34-6ebfd61db3cf service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.574756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a01c01a3-09d4-492e-8a2e-a449044de5de req-790ddc9b-eb61-4eb0-bf34-6ebfd61db3cf service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.593878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:18.594489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:18.599555 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-a01c01a3-09d4-492e-8a2e-a449044de5de req-790ddc9b-eb61-4eb0-bf34-6ebfd61db3cf service nova] Creating event network-vif-plugged:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:10:18.604501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.604951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.606330 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:18.606941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:18.612837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-a01c01a3-09d4-492e-8a2e-a449044de5de req-790ddc9b-eb61-4eb0-bf34-6ebfd61db3cf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056138 May 30 12:10:18.613613 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 283/594] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:18.741816 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:18.749511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7f8c38e1-ac68-4fd8-a8ea-4202b911658a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.159485 May 30 12:10:18.750090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 312/595] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:18 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:19.063031 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:19.063729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:19.070769 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.071522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.072313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.072748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.209197 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.216598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-06583177-195b-40bd-ba31-ed056e24bb71 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1682 microversion: 2.1 time: 0.157860 May 30 12:10:19.217159 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 284/596] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:19 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:19.310494 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:19.311044 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:19.319233 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.319682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.320481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.320917 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.557844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.567284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b465faae-5ea2-4d27-97d9-90ebd85a7bd8 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1452 microversion: 2.1 time: 0.260628 May 30 12:10:19.567886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 313/597] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:19 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1452 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:19.589229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:19.590300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:19.600484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.600938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.601722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.602161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.766288 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:19.766896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:19.779104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.779547 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.780415 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:19.780876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:19.781698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:19.789796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b9d1e6a5-ca35-4aa4-a15a-b348d6bc5a74 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1452 microversion: 2.1 time: 0.205284 May 30 12:10:19.790519 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 285/598] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:19 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1452 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:20.060394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:20.068721 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-33375ca4-c6cd-497a-b93e-c79968a97dc2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.306116 May 30 12:10:20.069306 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 314/599] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:19 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:20.234654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:20.235335 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:20.242665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:20.243162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:20.244060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:20.244675 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:20.360735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:20.371351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-41d1bcb1-4f33-4e55-b352-be0568a7b26a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1615 microversion: 2.1 time: 0.140841 May 30 12:10:20.372203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 286/600] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:20 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1615 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:20.771126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-517e819b-cd37-42c9-b6c1-fe12ddcb1141 req-9a7c99d2-6094-4abb-b5e7-bacbf693ae7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea5b29cb-133f-4082-a3f5-5094e70ccb3f", "name": "network-vif-deleted", "tag": "76cb0fb8-baf2-460c-8a68-05140c3ee881"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:20.781125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-517e819b-cd37-42c9-b6c1-fe12ddcb1141 req-9a7c99d2-6094-4abb-b5e7-bacbf693ae7d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:20.782353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-517e819b-cd37-42c9-b6c1-fe12ddcb1141 req-9a7c99d2-6094-4abb-b5e7-bacbf693ae7d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:20.795681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-517e819b-cd37-42c9-b6c1-fe12ddcb1141 req-9a7c99d2-6094-4abb-b5e7-bacbf693ae7d service nova] Creating event network-vif-deleted:76cb0fb8-baf2-460c-8a68-05140c3ee881 for instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f on hv-cinder-83979 May 30 12:10:20.802105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-517e819b-cd37-42c9-b6c1-fe12ddcb1141 req-9a7c99d2-6094-4abb-b5e7-bacbf693ae7d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 May 30 12:10:20.803482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 315/601] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:21.086822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:21.087906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:21.099413 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.100286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.101324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.101983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.342576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:21.360847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f174cdd1-ce8e-40be-87c2-4e6e9a06737a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1368 microversion: 2.1 time: 0.278038 May 30 12:10:21.370331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 287/602] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:21 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:21.390004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:21.390706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:21.399241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.399631 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.400563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.401197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.434419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:21.435111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:21.435556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'fault' on Instance uuid ea5b29cb-133f-4082-a3f5-5094e70ccb3f {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:21.489240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:21.497713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b658cd7e-3803-4aaf-8ca2-39a3bcf0ea10 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1331 microversion: 2.1 time: 0.112466 May 30 12:10:21.498294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 316/603] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:21 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:22.214462 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-d089b096-e57f-4ba8-8c84-97a40e7acba3 req-161966df-6703-4ceb-b311-fde76eb88ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b", "tag": "362343d9-e05b-46da-9e7b-f85cbc6ae1a1"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:22.223107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d089b096-e57f-4ba8-8c84-97a40e7acba3 req-161966df-6703-4ceb-b311-fde76eb88ce4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.223548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d089b096-e57f-4ba8-8c84-97a40e7acba3 req-161966df-6703-4ceb-b311-fde76eb88ce4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.227475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:22.235888 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-d089b096-e57f-4ba8-8c84-97a40e7acba3 req-161966df-6703-4ceb-b311-fde76eb88ce4 service nova] Creating event network-changed:362343d9-e05b-46da-9e7b-f85cbc6ae1a1 for instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b on hv-cinder-83979 May 30 12:10:22.240941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-d089b096-e57f-4ba8-8c84-97a40e7acba3 req-161966df-6703-4ceb-b311-fde76eb88ce4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030224 May 30 12:10:22.241528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 288/604] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:22.379282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.380685 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.387285 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.387720 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.388681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.389264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.518302 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.520714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.527437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:22.530998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:22.541125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ed2b7f57-cebf-4902-944e-94797e944e63 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1562 microversion: 2.1 time: 0.166811 May 30 12:10:22.541620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 317/605] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:22 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:22.543676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.544377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.545449 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.546028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.565436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:22.566995 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:22.575445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.576149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.577605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.578202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.588464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:22.588913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:22.589587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'fault' on Instance uuid ea5b29cb-133f-4082-a3f5-5094e70ccb3f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:22.650139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:22.665289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f538dd54-b48d-4d2d-aefc-4753f8a35f64 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 200 len: 1331 microversion: 2.1 time: 0.153555 May 30 12:10:22.666503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 289/606] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:22 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:10:22.683894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-94137477-e94e-4c2f-a6ba-b8cec280d7b7 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123330 May 30 12:10:22.684935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 318/607] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:10:22 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:23.681283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:23.681889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:23.688272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.688720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.690066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:23.690711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:23.704895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f HTTP/1.1 May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:10:23.707320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:10:23.708743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'ea5b29cb-133f-4082-a3f5-5094e70ccb3f'} May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:23.709637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:10:23.711068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:10:23.712809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:23.712809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fad81ae6-420c-4ec6-8127-a286be829f75 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.031288 May 30 12:10:23.712809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 290/608] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:23 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:23.720341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-aab95019-20b6-4f02-970f-c7e3a10553ad tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '.version_select at 0x7f61a1bc0e50>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:23.728137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:23.744037 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-aab95019-20b6-4f02-970f-c7e3a10553ad tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513559915" status: 202 len: 0 microversion: 2.1 time: 0.027291 May 30 12:10:23.744620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 319/609] 10.222.0.41 () {58 vars in 1220 bytes} [Mon May 30 12:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513559915 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:24.259077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-9b242121-6abb-436c-9e05-3777342dcc41 req-4d94b559-1400-4f3f-93a8-c8e7cddc6ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:24.267178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-9b242121-6abb-436c-9e05-3777342dcc41 req-4d94b559-1400-4f3f-93a8-c8e7cddc6ba8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.267650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-9b242121-6abb-436c-9e05-3777342dcc41 req-4d94b559-1400-4f3f-93a8-c8e7cddc6ba8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.279715 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-9b242121-6abb-436c-9e05-3777342dcc41 req-4d94b559-1400-4f3f-93a8-c8e7cddc6ba8 service nova] Creating event network-changed:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:10:24.291124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-9b242121-6abb-436c-9e05-3777342dcc41 req-4d94b559-1400-4f3f-93a8-c8e7cddc6ba8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 May 30 12:10:24.291905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 291/610] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:24.475746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:24.476710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:24.485516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.486126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.487786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.488361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.640168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'services' on Instance uuid 5505ae9e-14bf-49a2-9e34-b42e866bb86f {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:24.772577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a1a0684f-9c62-4f47-8731-0f2b8ef8ef2a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments/7a9cb29d-20c0-45ea-9cac-ac7e34f2a243" status: 202 len: 0 microversion: 2.1 time: 0.301509 May 30 12:10:24.774166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 320/611] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:10:24 2022] DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments/7a9cb29d-20c0-45ea-9cac-ac7e34f2a243 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:24.783706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:24.784768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:24.793469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.794167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.795183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:24.796004 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:24.834456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bd2b3225-a0e4-456e-af35-550e867c9a8e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055571 May 30 12:10:24.835372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 292/612] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:10:24 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:25.846504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:25.847572 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:25.855005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:25.855447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:25.856497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:25.856925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:25.860519 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:25.887257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1f27982f-4d48-4654-b04c-c82bb2e3315c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 May 30 12:10:25.887809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 321/613] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:10:25 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:26.899096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:26.900052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:26.906536 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:26.906983 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:26.907745 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:26.908946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:26.936747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-12ea29ed-0a8b-4d6d-ab23-20bc944168cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041550 May 30 12:10:26.937299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 293/614] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:10:26 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:10:26.995093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:26.995583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:27.002286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.002740 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.003505 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.003969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.034544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:10:27.120323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-09ba4c10-82f5-4467-a75a-95bd0430d8c8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 204 len: 0 microversion: 2.1 time: 0.128782 May 30 12:10:27.120916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 322/615] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:10:26 2022] DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:10:27.130138 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:27.130827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:27.137962 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.138443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.139222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:27.139663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:27.497362 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:27.505816 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6908fd23-fbfb-4faa-8ad4-fa95e063f6ea tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1680 microversion: 2.1 time: 0.380507 May 30 12:10:27.506369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 294/616] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:27 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1680 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:28.523653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:28.524374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:28.530770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:28.531216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:28.532006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:28.532444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:28.668780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:28.676227 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e71f6b48-3ab1-413f-bc71-14b3bc0d50a0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1680 microversion: 2.1 time: 0.156624 May 30 12:10:28.676885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 323/617] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:28 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:29.694086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:29.694708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:29.701409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:29.701864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:29.702633 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:29.703076 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:29.832650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:29.840200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-67b634fd-b97b-4847-ba70-5ed89cde6038 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1680 microversion: 2.1 time: 0.150046 May 30 12:10:29.840770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 295/618] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:29 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:30.858162 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:30.858797 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:30.866618 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:30.867068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:30.867842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:30.868343 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:30.941010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-b9b32a03-19e8-43ae-9ed1-a0474cc71d9c req-a4d436e1-9c53-49b9-afc2-341b9d03f16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5505ae9e-14bf-49a2-9e34-b42e866bb86f", "name": "network-vif-deleted", "tag": "d263c2ea-94ff-4515-becb-13b8808cda29"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:30.951972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b9b32a03-19e8-43ae-9ed1-a0474cc71d9c req-a4d436e1-9c53-49b9-afc2-341b9d03f16a service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:30.952810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b9b32a03-19e8-43ae-9ed1-a0474cc71d9c req-a4d436e1-9c53-49b9-afc2-341b9d03f16a service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:30.958768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:30.965680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-b9b32a03-19e8-43ae-9ed1-a0474cc71d9c req-a4d436e1-9c53-49b9-afc2-341b9d03f16a service nova] Creating event network-vif-deleted:d263c2ea-94ff-4515-becb-13b8808cda29 for instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f on hv-cinder-83979 May 30 12:10:30.966384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8b39a2e8-f227-4c77-a481-8dbb1d297eae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 200 len: 1613 microversion: 2.1 time: 0.112250 May 30 12:10:30.967470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 324/619] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:30 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 1613 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:30.971598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-b9b32a03-19e8-43ae-9ed1-a0474cc71d9c req-a4d436e1-9c53-49b9-afc2-341b9d03f16a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034343 May 30 12:10:30.972222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 296/620] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:10:31.989022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:31.990318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:31.997485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:31.997924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:31.998694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:31.999125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:32.013449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f HTTP/1.1 May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:10:32.015065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:10:32.016473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '5505ae9e-14bf-49a2-9e34-b42e866bb86f'} May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:10:32.018478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:10:32.020370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:10:32.021778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:10:32.021778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-476eb5e8-1822-4f57-8880-72fb7506d689 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 404 len: 111 microversion: 2.1 time: 0.035663 May 30 12:10:32.021778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 325/621] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:31 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:10:32.026841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c632f1e9-f6d9-4fe9-80f4-ac0dd521631e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '.version_select at 0x7f61a1c46f70>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:32.044090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c632f1e9-f6d9-4fe9-80f4-ac0dd521631e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796694744" status: 202 len: 0 microversion: 2.1 time: 0.021726 May 30 12:10:32.044621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 297/622] 10.222.0.41 () {58 vars in 1217 bytes} [Mon May 30 12:10:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796694744 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:10:32.680345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f3705fd4-62b5-42e6-8e54-06c22a2cd0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: .version_select at 0x7f61a1aa30d0>, body: {"keypair": {"name": "tempest-keypair-512510492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9sCPHykYeHrg7PVz+1OpRyAaf2DKlMAjZrSGr1kLYeQNrKXb4ew/NPP5fusGXJe3fgHUmpG8sM4W96Z4BbMvkBL0DnbdddCwDRBi6KlZV4PU9uS46YWbnUqMlUe8/lYg=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:32.695146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-f3705fd4-62b5-42e6-8e54-06c22a2cd0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:10:32.698877 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-f3705fd4-62b5-42e6-8e54-06c22a2cd0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:10:32.722058 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f3705fd4-62b5-42e6-8e54-06c22a2cd0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045660 May 30 12:10:32.722646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 326/623] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:10:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:33.373233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "905c09fc-e533-450f-bc2a-79b876e60ed4", "device": "/dev/sdb"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:33.374919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:33.383165 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:33.383663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:33.384545 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:33.384872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:33.676273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e174790d-f9ff-4934-97e4-7cc96accc925 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "POST /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306391 May 30 12:10:33.676898 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 298/624] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:10:33 2022] POST /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:34.035680 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1358311270", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc42f6ba-36b7-432a-8fd7-6b1f2c279d11"}], "security_groups": [{"name": "tempest-securitygroup--2062043576"}], "key_name": "tempest-keypair-512510492", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:34.135789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] validate_networks() for [('bc42f6ba-36b7-432a-8fd7-6b1f2c279d11', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:10:34.498456 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:10:34.498878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:10:34.499352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:10:34.499758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:10:34.500191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:10:34.509446 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.509890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:34.510685 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:34.511117 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:34.527135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:10:34.531046 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:10:34.542061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:10:34.544330 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:10:34.589327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b5fa79fe-8527-4f7f-9f05-cb733f7d2240 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.557828 May 30 12:10:34.589963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 327/625] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:10:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:10:34.601517 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-61a015ed-9c33-444d-bdee-724804707e7c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:34.602199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-61a015ed-9c33-444d-bdee-724804707e7c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:34.658924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-61a015ed-9c33-444d-bdee-724804707e7c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:34.665672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-61a015ed-9c33-444d-bdee-724804707e7c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1241 microversion: 2.1 time: 0.068916 May 30 12:10:34.666598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 299/626] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:34 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:35.684080 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:35.684825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:35.692643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:35.693032 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:35.693804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:35.694302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:35.761752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:35.769745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dcd70267-a90a-48ce-89c3-d10e3fea060e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1293 microversion: 2.1 time: 0.090088 May 30 12:10:35.779893 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 328/627] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:35 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:36.786998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:36.787962 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:36.795371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.795843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.796719 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:36.797442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:36.962688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:36.970464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3b3caaad-fe14-457e-ac13-f2d34c5a89a1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.187579 May 30 12:10:36.971848 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 300/628] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:36 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:37.472193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-014df887-0b4a-4cb5-a475-434871f91474 req-29c75312-686a-41ad-b728-4f1d788cfe75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d9528-b5d4-4793-8273-6f08e7934f0a", "tag": "956d3b74-7d9f-4dd7-8797-fc4134242746"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:37.506722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-014df887-0b4a-4cb5-a475-434871f91474 req-29c75312-686a-41ad-b728-4f1d788cfe75 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:37.511297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-014df887-0b4a-4cb5-a475-434871f91474 req-29c75312-686a-41ad-b728-4f1d788cfe75 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:37.523810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-014df887-0b4a-4cb5-a475-434871f91474 req-29c75312-686a-41ad-b728-4f1d788cfe75 service nova] Creating event network-changed:956d3b74-7d9f-4dd7-8797-fc4134242746 for instance 330d9528-b5d4-4793-8273-6f08e7934f0a on hv-cinder-83979 May 30 12:10:37.529115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-014df887-0b4a-4cb5-a475-434871f91474 req-29c75312-686a-41ad-b728-4f1d788cfe75 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062552 May 30 12:10:37.529928 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 329/629] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:37.987787 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:37.988409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:37.996087 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:37.996418 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:37.997196 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:37.997640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:38.134274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:38.141572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4e0ebc10-5777-4764-a7e1-3d7456cbfd91 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.158012 May 30 12:10:38.142138 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 301/630] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:37 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:39.158835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:39.159518 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:39.166152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:39.166597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:39.167355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:39.167780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:39.301784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:39.309258 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-56a7e32e-59ce-4029-b8e0-b972bf53d685 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.155307 May 30 12:10:39.309830 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 330/631] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:39 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:40.325905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:40.326456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:40.333037 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:40.333486 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:40.334246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:40.334685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:40.467410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:40.474864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4307d3f1-8ea8-4c05-8d57-306ba97652f4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.152994 May 30 12:10:40.475430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 302/632] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:40 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:41.492185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:41.492790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:41.499277 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:41.499726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:41.500525 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:41.500957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:41.638236 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:41.645894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-99b53663-9068-4a20-9916-ab068f56847a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.157637 May 30 12:10:41.646489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 331/633] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:41 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:42.662392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:42.663311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:42.669994 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:42.670450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:42.671222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:42.671660 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:42.804688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:42.812117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b0911b83-00c3-4dae-9a41-9ea6c5215cdb tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.153500 May 30 12:10:42.812669 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 303/634] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:42 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:42.994610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-13ff6d94-27d3-4368-b8c2-a7e1ab015113 req-df01a95d-3421-4a39-a8dc-443758d9c373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d9528-b5d4-4793-8273-6f08e7934f0a", "name": "network-vif-plugged", "status": "completed", "tag": "956d3b74-7d9f-4dd7-8797-fc4134242746"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:43.003424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-13ff6d94-27d3-4368-b8c2-a7e1ab015113 req-df01a95d-3421-4a39-a8dc-443758d9c373 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:43.004069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-13ff6d94-27d3-4368-b8c2-a7e1ab015113 req-df01a95d-3421-4a39-a8dc-443758d9c373 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:43.015188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-13ff6d94-27d3-4368-b8c2-a7e1ab015113 req-df01a95d-3421-4a39-a8dc-443758d9c373 service nova] Creating event network-vif-plugged:956d3b74-7d9f-4dd7-8797-fc4134242746 for instance 330d9528-b5d4-4793-8273-6f08e7934f0a on hv-cinder-83979 May 30 12:10:43.020079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-13ff6d94-27d3-4368-b8c2-a7e1ab015113 req-df01a95d-3421-4a39-a8dc-443758d9c373 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029220 May 30 12:10:43.020829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 332/635] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:43.830171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:43.830875 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:43.837383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:43.837834 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:43.838594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:43.839031 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:43.964504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:43.971911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a2475732-bffc-476d-b486-7853828bf2ee tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.146202 May 30 12:10:43.972470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 304/636] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:43 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:44.986483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:44.987252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=10 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:44.992327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:44.993030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:45.000133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.000584 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.001679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:45.002146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:45.132486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:45.139805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f992caa4-5200-4633-83fb-4b415ddb3b8b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.154870 May 30 12:10:45.140387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 333/637] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:44 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:46.156437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:46.156975 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:46.159002 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:46.164926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.165385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.166151 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:46.166594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:46.300172 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:46.307471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7c227842-1f8a-4a2c-b26e-74797697996b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.154970 May 30 12:10:46.308070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 305/638] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:46 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:47.325140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:47.325662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:47.333389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:47.333831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:47.334896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:47.335342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:47.467795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:47.475952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f387e7d4-2655-4f79-acc5-4fd4b67ca5d7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.154664 May 30 12:10:47.476603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 334/639] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:47 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:48.493147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:48.493760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:48.500211 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:48.500662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:48.501455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:48.501889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:48.630305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:48.637774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6daf9484-728c-4720-95d9-970d039eee9f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.148427 May 30 12:10:48.638564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 306/640] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:48 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:49.656188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:49.656803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:49.664348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:49.664826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:49.665590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:49.666032 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:49.794594 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:49.802523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b3b175cc-f8d2-49d0-aff7-141afd6b30ab tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.150309 May 30 12:10:49.803092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 335/641] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:49 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:50.819081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:50.819694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:50.826272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:50.826718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:50.827475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:50.827945 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:50.965608 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:50.968345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:50.975380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e77f9cba-c141-4d87-9788-3f00030a1696 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1367 microversion: 2.1 time: 0.160038 May 30 12:10:50.976275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 307/642] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:50 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:51.993833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:51.994481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:52.001290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.001746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.002512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.002949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.137488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:10:52.145611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d35a8279-c528-40ff-92e2-2655d68a82f8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1557 microversion: 2.1 time: 0.155676 May 30 12:10:52.146182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 336/643] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:10:51 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:10:52.161933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:52.162531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:52.169816 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.170262 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.171024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:52.171458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:52.247849 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-18970c44-a4f0-40de-be83-63097e2c90e4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090009 May 30 12:10:52.248473 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 308/644] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:10:52 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:53.161958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-f456a54c-8e26-41fe-aea9-4e19f795d608 req-1beb4178-3786-4bd6-bd55-d4cfbb9b0c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "330d9528-b5d4-4793-8273-6f08e7934f0a", "tag": "956d3b74-7d9f-4dd7-8797-fc4134242746"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:10:53.170586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-f456a54c-8e26-41fe-aea9-4e19f795d608 req-1beb4178-3786-4bd6-bd55-d4cfbb9b0c8b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:53.171099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-f456a54c-8e26-41fe-aea9-4e19f795d608 req-1beb4178-3786-4bd6-bd55-d4cfbb9b0c8b service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:53.182813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-f456a54c-8e26-41fe-aea9-4e19f795d608 req-1beb4178-3786-4bd6-bd55-d4cfbb9b0c8b service nova] Creating event network-changed:956d3b74-7d9f-4dd7-8797-fc4134242746 for instance 330d9528-b5d4-4793-8273-6f08e7934f0a on hv-cinder-83979 May 30 12:10:53.187983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-f456a54c-8e26-41fe-aea9-4e19f795d608 req-1beb4178-3786-4bd6-bd55-d4cfbb9b0c8b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029719 May 30 12:10:53.189406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 337/645] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:10:58.476723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:10:58.477263 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:10:58.479115 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:10:58.484830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:58.485284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:58.486052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:10:58.486492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:10:58.613719 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lazy-loading 'services' on Instance uuid 43ef40cb-34ac-461b-a737-8a21131602c6 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:10:58.724651 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-90563733-1daf-40ce-9293-49a8a210b49b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "DELETE /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6/os-volume_attachments/905c09fc-e533-450f-bc2a-79b876e60ed4" status: 202 len: 0 microversion: 2.1 time: 0.253114 May 30 12:10:58.725269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 309/646] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:10:58 2022] DELETE /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6/os-volume_attachments/905c09fc-e533-450f-bc2a-79b876e60ed4 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:11:00.895504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:00.896126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:00.898252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:00.904189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:00.904642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:00.905412 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:00.905850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:00.909939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:00.936444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:11:01.009788 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ebde1f2b-533f-404a-88b8-25c5c2d69688 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "DELETE /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 204 len: 0 microversion: 2.1 time: 0.118302 May 30 12:11:01.013469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 338/647] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:11:00 2022] DELETE /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:11:01.020526 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:01.021224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:01.027486 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:01.027930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:01.028690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:01.029128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:01.159020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:01.166791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7ff33390-4faa-4e42-9520-b0e591772d87 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1513 microversion: 2.1 time: 0.151750 May 30 12:11:01.167355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 310/648] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:01 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:02.185590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:02.186274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:02.193760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:02.194204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:02.194955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:02.195384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:02.326900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:02.335123 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fb863a80-e78e-4fa7-8391-f8776999af01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1513 microversion: 2.1 time: 0.153684 May 30 12:11:02.335696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 339/649] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:02 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:03.353748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:03.354284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:03.361610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:03.362356 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:03.363182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:03.363619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:03.501918 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:03.510670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-140e7096-2a61-4bed-b025-73186fa54cd3 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1513 microversion: 2.1 time: 0.161650 May 30 12:11:03.511247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 311/650] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:03 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:04.529078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:04.529766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:04.536596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:04.537043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:04.537810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:04.538246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:04.672159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:04.680839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-54e25d20-9b42-47b2-a4de-5ab09e256274 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1513 microversion: 2.1 time: 0.155661 May 30 12:11:04.681419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 340/651] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:04 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:04.831605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-ebbd0f12-3ae9-429a-b225-709bfb43ea94 req-31c9bc9e-027f-4351-a46b-ccb38a28a135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43ef40cb-34ac-461b-a737-8a21131602c6", "name": "network-vif-deleted", "tag": "c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:04.841052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-ebbd0f12-3ae9-429a-b225-709bfb43ea94 req-31c9bc9e-027f-4351-a46b-ccb38a28a135 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:04.841504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-ebbd0f12-3ae9-429a-b225-709bfb43ea94 req-31c9bc9e-027f-4351-a46b-ccb38a28a135 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:04.852324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-ebbd0f12-3ae9-429a-b225-709bfb43ea94 req-31c9bc9e-027f-4351-a46b-ccb38a28a135 service nova] Creating event network-vif-deleted:c39e1dd6-2631-4b6e-a5c3-ef61dd2326b7 for instance 43ef40cb-34ac-461b-a737-8a21131602c6 on hv-cinder-83979 May 30 12:11:04.857207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-ebbd0f12-3ae9-429a-b225-709bfb43ea94 req-31c9bc9e-027f-4351-a46b-ccb38a28a135 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029309 May 30 12:11:04.857783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 312/652] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:05.698274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:05.698933 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:05.705412 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:05.706488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:05.707259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:05.707692 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:05.740039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:05.740482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:05.740926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lazy-loading 'fault' on Instance uuid 43ef40cb-34ac-461b-a737-8a21131602c6 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:05.796856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:05.804792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b6a74fe1-5b68-47b6-a51b-29702834a009 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 200 len: 1309 microversion: 2.1 time: 0.110375 May 30 12:11:05.805352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 341/653] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:05 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:06.606953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:06.607458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:06.614578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:06.615033 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:06.615805 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:06.616345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:06.698650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lazy-loading 'services' on Instance uuid 74de07ed-a2fe-45f8-ac09-ec21741046db {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:06.770352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fa87d197-ce73-423a-9462-14147d91df88 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments/0db61a2f-a4cf-447b-bf8d-43b83d0b3594" status: 202 len: 0 microversion: 2.1 time: 0.168289 May 30 12:11:06.771108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 313/654] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:11:06 2022] DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments/0db61a2f-a4cf-447b-bf8d-43b83d0b3594 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:11:06.822362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:06.823067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 43ef40cb-34ac-461b-a737-8a21131602c6] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:06.829472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:06.829921 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:06.830717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:06.831329 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:06.844476 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] HTTP exception thrown: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Request method failure captured: May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 HTTP/1.1 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLP9Y7K72sUNUiavXIOiYtazFuLtA_830fk-SOO3QK6-h3EMUlRbJqO1Ou3fnscfGno544FapUvH29AHTS2Yx9gDM5ROG38PPXWW4lDXInMA2to45kA2goAl7Oh-DmSVz8uADcnhb7c312N55TTU030t2SU_jDwfueminFl8JhNMOeA May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 4d363027ab254adfb4ba1b13de71d7e7 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:11:06.846607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4d363027ab254adfb4ba1b13de71d7e7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 4d363027ab254adfb4ba1b13de71d7e7 May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesSnapshotTestJSON-731724303-project May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: dbe77e4880a44d259fac8dfa05722f18 May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesSnapshotTestJSON-731724303-project May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. May 30 12:11:06.848462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '43ef40cb-34ac-461b-a737-8a21131602c6'} May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:06.849408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. May 30 12:11:06.850926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:11:06.852203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Returning 404 to user: Instance 43ef40cb-34ac-461b-a737-8a21131602c6 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:06.852203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e8da131a-322b-4af8-86ed-5d3ece2d41f6 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6" status: 404 len: 111 microversion: 2.1 time: 0.029663 May 30 12:11:06.852203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 342/655] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:06 2022] GET /compute/v2.1/servers/43ef40cb-34ac-461b-a737-8a21131602c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:11:11.047097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f29c2da7-e78d-4ce4-b8d1-c5b80a74a661 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:11.054119 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f29c2da7-e78d-4ce4-b8d1-c5b80a74a661 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:11.054578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f29c2da7-e78d-4ce4-b8d1-c5b80a74a661 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:11.076941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f29c2da7-e78d-4ce4-b8d1-c5b80a74a661 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Going to try to stop instance {{(pid=117706) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 30 12:11:11.120278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f29c2da7-e78d-4ce4-b8d1-c5b80a74a661 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action" status: 202 len: 0 microversion: 2.1 time: 0.077889 May 30 12:11:11.121008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 314/656] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:11:11 2022] POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:11:11.130043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:11.130962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:11.138779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:11.139472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:11.140537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:11.141071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:11.278278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:11.286894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d438d222-b92d-43c3-a173-0efc65d2fb0a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.161774 May 30 12:11:11.287462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 343/657] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:11 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:12.304937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:12.305672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:12.312398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:12.312841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:12.313596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:12.314027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:12.449914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:12.459570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4a1dacce-45e4-47d1-97b5-d76a51722bc6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.158947 May 30 12:11:12.460178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 315/658] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:12 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:13.476444 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:13.477051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:13.484096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:13.484543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:13.485296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:13.485726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:13.619783 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:13.627325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4a76ca53-abe8-4699-ab37-feb4da424a5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.154543 May 30 12:11:13.628022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 344/659] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:13 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:14.644664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:14.645300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:14.651703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:14.652178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:14.652935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:14.653375 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:14.780934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:14.789346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-409e2164-64b1-4bf9-a164-f4dc055e692b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.148873 May 30 12:11:14.789907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 316/660] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:14 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:15.807781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:15.808414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:15.814863 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:15.815305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:15.816092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:15.816527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:15.945862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:15.954560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3ab71062-48ea-4777-80b1-2987cafe6e1d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.150612 May 30 12:11:15.955798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 345/661] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:15 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:16.697485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1124604624", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "networks": [{"uuid": "745efbf4-510e-4a77-9f91-b1d957f4108c"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:16.748987 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] validate_networks() for [('745efbf4-510e-4a77-9f91-b1d957f4108c', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:11:16.974409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:16.975222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:16.981955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:16.982488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:16.983254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:16.983690 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.134335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:17.143409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-346f6e49-bffe-453b-9636-018d7a7653a4 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.172841 May 30 12:11:17.144219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 346/662] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:16 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:17.315321 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:11:17.315767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:11:17.316267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:11:17.316669 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:11:17.317071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:11:17.326602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:17.327054 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.327883 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:17.328333 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:17.344681 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Getting quotas for project 4d363027ab254adfb4ba1b13de71d7e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:17.348752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Getting quotas for user dbe77e4880a44d259fac8dfa05722f18 and project 4d363027ab254adfb4ba1b13de71d7e7. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:17.359750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:11:17.362617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:11:17.409178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-93fcf760-3870-41b3-9b14-67d902f67364 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.715502 May 30 12:11:17.409822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 317/663] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:11:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:11:17.420200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d2e9d5b7-4935-4139-95cf-cfe55fd14548 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:17.420806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d2e9d5b7-4935-4139-95cf-cfe55fd14548 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:17.474410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d2e9d5b7-4935-4139-95cf-cfe55fd14548 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:17.481278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d2e9d5b7-4935-4139-95cf-cfe55fd14548 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1219 microversion: 2.1 time: 0.065501 May 30 12:11:17.481846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 347/664] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:17 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:18.162030 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:18.162639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:18.169340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.169795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.170564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.171010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.302273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:18.309656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-263a72f6-b52d-4747-bbc6-48cd61cf93ab tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.152583 May 30 12:11:18.310217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 318/665] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:18 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:18.498804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:18.499408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:18.506939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.507382 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.508168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:18.508602 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:18.570332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:18.577764 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-992a1d68-7880-4512-8c79-783f7ef62c96 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1271 microversion: 2.1 time: 0.082854 May 30 12:11:18.578318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 348/666] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:18 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:18.999543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.000103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.007497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.007979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.009055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.009559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.039354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a3e3d580-10cd-4753-a18f-bab58b1bfc7a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments/dee1d403-7d9e-41f2-8732-c666c60f55cd" status: 200 len: 194 microversion: 2.20 time: 0.043462 May 30 12:11:19.040343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 319/667] 10.222.0.41 () {60 vars in 1453 bytes} [Mon May 30 12:11:18 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments/dee1d403-7d9e-41f2-8732-c666c60f55cd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:11:19.104612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.105383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.111994 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.112657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.113419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.113855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.194904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lazy-loading 'services' on Instance uuid c9cdf2a8-edd4-4a18-8fa9-443148005b88 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:19.270369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f0aeeecc-648e-437d-b1a9-ad1f37c90d97 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments/dee1d403-7d9e-41f2-8732-c666c60f55cd" status: 202 len: 0 microversion: 2.20 time: 0.169450 May 30 12:11:19.270973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 349/668] 10.222.0.41 () {60 vars in 1456 bytes} [Mon May 30 12:11:19 2022] DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments/dee1d403-7d9e-41f2-8732-c666c60f55cd => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:11:19.279579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.280601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.287714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.288478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.289190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.289896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.324249 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-747522cf-e5ec-4318-a2e1-a76fdc44bf37 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048759 May 30 12:11:19.324811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 320/669] 10.222.0.41 () {60 vars in 1342 bytes} [Mon May 30 12:11:19 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:11:19.326980 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.327736 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.336566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.338068 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.338849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.339649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.486094 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:19.493431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e7aee852-3f5b-4db4-8d81-e0e5f9a6f3df tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.170670 May 30 12:11:19.494001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 350/670] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:19 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:19.596437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:19.596973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:19.602873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.603322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.604108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:19.604547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:19.729467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:19.737126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9abc320b-e5c7-42ff-80fc-96777834dffd tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.145248 May 30 12:11:19.737681 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 321/671] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:19 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:20.336243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.337246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.344114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.344563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.345361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.345814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.379084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-94a6a5d1-f97d-40f3-9a7e-c2a91eb7612e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046814 May 30 12:11:20.379667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 351/672] 10.222.0.41 () {60 vars in 1342 bytes} [Mon May 30 12:11:20 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:11:20.510905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.511557 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.518630 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.519593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.520573 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.522806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.718358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-3983b6dc-ecb1-4c91-ac60-173d1c51c583 req-82b30cdc-11dc-4a54-b154-396d6199e6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "640e40ad-15ab-48aa-acf1-4535e1343f69", "tag": "be6155ca-2caa-4280-a17e-39805fcc0dd8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:20.728339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3983b6dc-ecb1-4c91-ac60-173d1c51c583 req-82b30cdc-11dc-4a54-b154-396d6199e6ad service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.728844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3983b6dc-ecb1-4c91-ac60-173d1c51c583 req-82b30cdc-11dc-4a54-b154-396d6199e6ad service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.741734 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-3983b6dc-ecb1-4c91-ac60-173d1c51c583 req-82b30cdc-11dc-4a54-b154-396d6199e6ad service nova] Creating event network-changed:be6155ca-2caa-4280-a17e-39805fcc0dd8 for instance 640e40ad-15ab-48aa-acf1-4535e1343f69 on hv-cinder-83979 May 30 12:11:20.742801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.746758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-3983b6dc-ecb1-4c91-ac60-173d1c51c583 req-82b30cdc-11dc-4a54-b154-396d6199e6ad service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 May 30 12:11:20.749503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 352/673] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:20.755529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:20.756287 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:20.757133 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e9ba1b14-83ba-42b4-b544-4629b6240d06 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.250037 May 30 12:11:20.757812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 322/674] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:20 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:20.762949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.763402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.774156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:20.774632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:20.907007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:20.915605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-53eb8b44-6d9d-420f-a85c-26354fadafae tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.164115 May 30 12:11:20.916129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 353/675] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:20 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:21.390735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.391610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.398928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.399384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.400261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.400718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.424833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:21.429428 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-feb5bfc9-eb31-404f-a577-e0ab4b457ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042757 May 30 12:11:21.429992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 323/676] 10.222.0.41 () {60 vars in 1342 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:21.486855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.487345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.493881 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.494331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.495092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.495528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.510642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:21.522903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:11:21.599138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-46cfea3c-6420-4487-9486-0b53db7d308a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 204 len: 0 microversion: 2.20 time: 0.115914 May 30 12:11:21.599721 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 354/677] 10.222.0.41 () {60 vars in 1279 bytes} [Mon May 30 12:11:21 2022] DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:11:21.609118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.609736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.617385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.617870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.618642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.619081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.747160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.755811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.757406 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.758578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5687db48-0542-444c-b291-021f94fd8b7f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.154403 May 30 12:11:21.759143 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 324/678] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:21.775688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.776434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.782400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.782983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.784278 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.784713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.915654 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:21.923104 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ae238119-3203-4a12-b483-fa4f5366cf4d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.151577 May 30 12:11:21.923996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 355/679] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:21.933226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:21.933850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:21.940511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.940963 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:21.941744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:21.942166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.067662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.075042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c6a0f9bd-2aaa-4574-b9b0-2fecd34105a0 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.145696 May 30 12:11:22.075607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 325/680] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:21 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:22.777366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:22.778008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:22.785304 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.785754 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.786524 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.786959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.917991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.926449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.928007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:22.929168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0a6d98d6-d3fc-45ae-b780-2ef0aabaf966 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.155708 May 30 12:11:22.930077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 356/681] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:22 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:22.939688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:22.940362 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:22.946768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.947213 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:22.948006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:22.948445 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.085725 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.092900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:23.093176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-918887fd-48d3-44fc-956e-f8f19deb6b70 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.157428 May 30 12:11:23.093519 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:23.093737 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 326/682] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:22 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:23.100789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.101238 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.102005 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.102441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.229397 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:23.237232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0fddae5d-a066-416d-8d02-1b1d538d7b71 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.148378 May 30 12:11:23.237799 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 357/683] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:23 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:23.946980 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:23.947524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:23.953970 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.954409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:23.955718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:23.956179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.083618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.091409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.092941 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.094097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8ebd179a-e84e-4b0f-97f2-4870680d03de tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.151068 May 30 12:11:24.094648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 327/684] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:23 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:24.110539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:24.111978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:24.117921 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.118372 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.119134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.119573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.250507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.253415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:24.254035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:24.258144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9f45814f-0d6d-455a-a7f3-dd64723854de tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.151437 May 30 12:11:24.258751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 358/685] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:24 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:24.260222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.260669 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.261438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:24.261870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:24.393700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:24.401351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-33bb5b0f-d34e-4e8d-84be-3b76a439ed01 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.151798 May 30 12:11:24.401946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 328/686] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:24 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:25.112749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:25.113359 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:25.119784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.120268 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.121035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.121467 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.260432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.270773 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.270898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.272736 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-54bc2272-e606-41cb-98e0-26512fed2737 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.163781 May 30 12:11:25.273829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 359/687] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:25 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:25.275620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:25.276266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:25.282481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.283155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.283951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.284391 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.418332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:25.419004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:25.425670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.426117 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.426886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:25.427323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:25.431196 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.438755 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6113fd01-1fd8-4ef3-9924-3ee9d912c8cf tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.166851 May 30 12:11:25.446870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 329/688] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:25 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:25.555491 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:25.563325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b612c4c5-79ac-4db6-bd13-578f71b688c7 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.148744 May 30 12:11:25.563929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 360/689] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:25 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:26.291745 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.292408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.299012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.299455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.300241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.300679 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.429229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.437534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.440001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.441214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-19f3f7f1-aeda-4da3-89e4-c16e1da6b3d4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1723 microversion: 2.20 time: 0.153392 May 30 12:11:26.441810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 330/690] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:26.456954 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.457687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.464331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.464785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.465643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.466253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.580490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:26.581109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:26.587146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.587599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.588405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.588845 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.696993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.704811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-17d0ba68-0ff3-4496-b8e5-b601cc6579cb tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.252213 May 30 12:11:26.714296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 361/691] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:26.733576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:26.741738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-054817a1-3262-4ea7-86ae-0e28d87e5f03 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.165076 May 30 12:11:26.742321 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 331/692] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:26 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:26.869670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-9b1bd516-d0c5-4313-94c5-67421c2f5e3c req-be15f976-93e7-4520-880d-a48f3acaa81f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9cdf2a8-edd4-4a18-8fa9-443148005b88", "name": "network-vif-deleted", "tag": "a4c52131-13be-43cc-8574-87243f8829c3"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:26.878049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-9b1bd516-d0c5-4313-94c5-67421c2f5e3c req-be15f976-93e7-4520-880d-a48f3acaa81f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:26.878493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-9b1bd516-d0c5-4313-94c5-67421c2f5e3c req-be15f976-93e7-4520-880d-a48f3acaa81f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:26.901070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-9b1bd516-d0c5-4313-94c5-67421c2f5e3c req-be15f976-93e7-4520-880d-a48f3acaa81f service nova] Creating event network-vif-deleted:a4c52131-13be-43cc-8574-87243f8829c3 for instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 on hv-cinder-83979 May 30 12:11:26.907452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-9b1bd516-d0c5-4313-94c5-67421c2f5e3c req-be15f976-93e7-4520-880d-a48f3acaa81f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041385 May 30 12:11:26.909217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 362/693] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:27.264049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-21e55330-c9ce-4e62-9f05-e124e0068142 req-34315ae8-6e79-4022-94d3-c18bed025cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640e40ad-15ab-48aa-acf1-4535e1343f69", "name": "network-vif-plugged", "status": "completed", "tag": "be6155ca-2caa-4280-a17e-39805fcc0dd8"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:27.274310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-21e55330-c9ce-4e62-9f05-e124e0068142 req-34315ae8-6e79-4022-94d3-c18bed025cc8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.274992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-21e55330-c9ce-4e62-9f05-e124e0068142 req-34315ae8-6e79-4022-94d3-c18bed025cc8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.288190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-21e55330-c9ce-4e62-9f05-e124e0068142 req-34315ae8-6e79-4022-94d3-c18bed025cc8 service nova] Creating event network-vif-plugged:be6155ca-2caa-4280-a17e-39805fcc0dd8 for instance 640e40ad-15ab-48aa-acf1-4535e1343f69 on hv-cinder-83979 May 30 12:11:27.293472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-21e55330-c9ce-4e62-9f05-e124e0068142 req-34315ae8-6e79-4022-94d3-c18bed025cc8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033189 May 30 12:11:27.294226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 332/694] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:27.460487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.461829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.468538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.468903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.469669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.470128 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.486000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:27.506383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.506820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.507265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lazy-loading 'fault' on Instance uuid c9cdf2a8-edd4-4a18-8fa9-443148005b88 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:27.552479 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.561881 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.564694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.566202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b267332d-bdfe-4483-8c04-46bb00a40c79 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 200 len: 1371 microversion: 2.20 time: 0.111357 May 30 12:11:27.566788 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 363/695] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 1371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:27.722640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.723912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.728616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:27.729847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:27.739467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.740128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.740905 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.741338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.758527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:27.759121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:27.767590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.768059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.768841 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:27.769265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:27.907160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:27.915747 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7a01f48b-af22-4dcf-b93c-df1739e90f6b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1679 microversion: 2.1 time: 0.197338 May 30 12:11:27.916352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 333/696] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:28.004987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:28.013500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-adc5b2e0-24a5-470b-8363-fcf2664644f4 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.258725 May 30 12:11:28.014322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 364/697] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:27 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:28.585292 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:28.585891 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:28.587715 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:28.592995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.593437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:28.594190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.594618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:28.608671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 HTTP/1.1 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:11:28.610288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:11:28.612465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'c9cdf2a8-edd4-4a18-8fa9-443148005b88'} May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:11:28.613370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:11:28.614699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:11:28.616019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:11:28.616019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e4b54fc1-851f-4387-961b-243ab8b811d6 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 404 len: 111 microversion: 2.20 time: 0.031452 May 30 12:11:28.616019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 334/698] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:28 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:11:28.621400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0457a9f0-98b5-4647-98a7-6523be094121 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '.version_select at 0x7f61a1acf550>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:28.639228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0457a9f0-98b5-4647-98a7-6523be094121 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-321243116" status: 204 len: 0 microversion: 2.20 time: 0.021581 May 30 12:11:28.639795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 365/699] 10.222.0.41 () {60 vars in 1258 bytes} [Mon May 30 12:11:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-321243116 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:11:28.933600 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:28.934345 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:28.940873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.941331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:28.942094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:28.942531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.030516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:29.031396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:29.039392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.040053 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.040965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.041535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.075031 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.085485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d9fdef3f-011d-4535-b5e8-e37f0fa573e6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1656 microversion: 2.1 time: 0.155709 May 30 12:11:29.091869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 335/700] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:28 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:29.102846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-236fa5d0-a842-465d-b978-ce59a4540e29 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:29.109300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-236fa5d0-a842-465d-b978-ce59a4540e29 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.109760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-236fa5d0-a842-465d-b978-ce59a4540e29 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.132799 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-236fa5d0-a842-465d-b978-ce59a4540e29 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Going to try to start instance {{(pid=117706) start /opt/stack/nova/nova/compute/api.py:2730}} May 30 12:11:29.176482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-236fa5d0-a842-465d-b978-ce59a4540e29 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action" status: 202 len: 0 microversion: 2.1 time: 0.077201 May 30 12:11:29.179933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 336/701] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:11:29 2022] POST /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:11:29.185270 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:29.185968 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:29.192615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.193072 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.193843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:29.194278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:29.224360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.234531 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dc8c805e-3892-49a3-ae35-fd8e037e486c tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.207759 May 30 12:11:29.245873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 366/702] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:29 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:29.338830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:29.351022 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-002226b4-c9c4-4787-b8a7-793ce6be7d2d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1665 microversion: 2.1 time: 0.169729 May 30 12:11:29.351685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 337/703] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:29 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1665 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:29.353582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7fdb9ac0-9232-4981-881e-9e57581bd595 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: .version_select at 0x7f61a1ab6e50>, body: {"keypair": {"name": "tempest-keypair-1790771032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQEfJsYfXie6EmYnXuObtNnDk4vKIuZcHblZdV3+eLsIP5omRZ42loP9fuTuh5i55vifXgMJ5DeyVtpzP0xQOUhX6Ltq7bZ4lxCBlcwPFRQG8mfHLNTfl+CBzqNtJlLPg=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:29.368540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-7fdb9ac0-9232-4981-881e-9e57581bd595 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for project 185231fbe57e438a9ee70b39991235b2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:29.372546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-7fdb9ac0-9232-4981-881e-9e57581bd595 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for user 9c9292fdef7f41af8fcb9375ce1764e2 and project 185231fbe57e438a9ee70b39991235b2. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:29.394787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7fdb9ac0-9232-4981-881e-9e57581bd595 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045514 May 30 12:11:29.395399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 367/704] 10.222.0.41 () {62 vars in 1199 bytes} [Mon May 30 12:11:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 30 12:11:30.252408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.252929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:30.259445 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.260105 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.260884 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.261320 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.369344 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:30.370141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:30.377988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.378671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.379452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:30.379925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:30.398588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:30.407268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-de8fd2a6-b2e8-4232-9c4f-4f9f85091df1 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1319 microversion: 2.1 time: 0.159356 May 30 12:11:30.409031 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 338/705] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:30 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:30.589555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:30.597789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2a5d8fce-6ae7-4009-add3-41ad94e72009 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1665 microversion: 2.1 time: 0.232412 May 30 12:11:30.598968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 368/706] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:30 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:30.855019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-871272045", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0267d625-b0e5-4dff-a6d4-b0221d482c6b"}], "security_groups": [{"name": "tempest-securitygroup--2002203527"}], "key_name": "tempest-keypair-1790771032", "user_data": "}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:30.958419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] validate_networks() for [('0267d625-b0e5-4dff-a6d4-b0221d482c6b', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:11:31.324432 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:11:31.325015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:11:31.325329 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:11:31.325740 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:11:31.326154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:11:31.336026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.336476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.337276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.337718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.354953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for project 185231fbe57e438a9ee70b39991235b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:11:31.358820 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Getting quotas for user 9c9292fdef7f41af8fcb9375ce1764e2 and project 185231fbe57e438a9ee70b39991235b2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:11:31.369719 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:11:31.372016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:11:31.418395 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7cc63d40-e0a0-4b42-96af-0760917a83d9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.567857 May 30 12:11:31.419229 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 339/707] 10.222.0.41 () {62 vars in 1187 bytes} [Mon May 30 12:11:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 30 12:11:31.425214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:31.426372 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:31.429222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:31.429579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:31.429732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:31.434158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.434885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.436735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.437354 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.495047 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.504867 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.506431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.507576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5c634cab-c199-4b28-b9e1-b66b6dbbe4e3 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1281 microversion: 2.20 time: 0.082477 May 30 12:11:31.518680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 340/708] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:31 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1281 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:31.615048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:31.615768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:31.625987 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.626990 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.628089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.628704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.778163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.786147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-706b7e65-ec5d-475c-8186-918023cc13cd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1665 microversion: 2.1 time: 0.175431 May 30 12:11:31.786908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 341/709] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:31 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1665 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:31.834193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:31.841980 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7dcfe1c4-633b-4cc5-8a7b-c66ad0939075 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1508 microversion: 2.1 time: 0.420840 May 30 12:11:31.842555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 369/710] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:31 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1508 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:31.859155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d09e366a-f7f2-43a8-bd69-aca6691878a2", "device": "/dev/sdb"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:31.860341 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:31.867438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.867849 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.868683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:31.869124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:31.883943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:32.526406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.526999 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.533658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.534091 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.534835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.535258 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.594682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.603453 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.605229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.606304 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f614fac6-1291-4dcb-8a7e-22bf35f43826 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1277 microversion: 2.20 time: 0.083830 May 30 12:11:32.606860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 370/711] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:32 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:11:32.804416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:32.804996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:32.811225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.811676 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.812475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:32.812915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:32.948161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:32.950370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:32.957907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-96d3f0a8-bd1c-4465-a0d8-ce7f58da1650 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1669 microversion: 2.1 time: 0.157304 May 30 12:11:32.958477 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 371/712] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:32 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:11:33.140436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a7ce5f59-cae5-4029-9746-fdd41b428a0d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "POST /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285238 May 30 12:11:33.141099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 342/713] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:11:31 2022] POST /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69/os-volume_attachments => generated 194 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:33.623130 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:33.623736 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:33.632282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.632728 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.633485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:33.633914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:33.698865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:33.708282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:33.709838 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:33.711008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bfb9c108-ecd5-4a8d-a9ed-c0ace4483866 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1333 microversion: 2.20 time: 0.091761 May 30 12:11:33.711565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 372/714] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:33 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:34.731057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:34.731758 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:34.739928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:34.740490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:34.741531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:34.742394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.016461 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.026668 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.028201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:35.029455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c2159131-f6f5-46ae-b22c-6259e6562ac2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.303028 May 30 12:11:35.030339 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 343/715] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:34 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:35.468256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-1ea22bac-141e-470d-bf57-5878521e4c6a req-8e55369f-ab84-413e-84fe-ab1b75c6353f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:35.484072 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-1ea22bac-141e-470d-bf57-5878521e4c6a req-8e55369f-ab84-413e-84fe-ab1b75c6353f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:35.484868 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-1ea22bac-141e-470d-bf57-5878521e4c6a req-8e55369f-ab84-413e-84fe-ab1b75c6353f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:35.506520 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-1ea22bac-141e-470d-bf57-5878521e4c6a req-8e55369f-ab84-413e-84fe-ab1b75c6353f service nova] Creating event network-changed:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:11:35.511641 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-1ea22bac-141e-470d-bf57-5878521e4c6a req-8e55369f-ab84-413e-84fe-ab1b75c6353f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046986 May 30 12:11:35.512558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 373/716] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:11:36.048645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:36.049511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:36.055888 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:36.056346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:36.057117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:36.057558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:36.184832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:36.192873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:36.194385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:36.195484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b85927ae-f2fd-41f6-a8c0-f6e5ba10b589 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.151575 May 30 12:11:36.196094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 344/717] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:36 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:11:37.214395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:37.215078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:37.221717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:37.222158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:37.222907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:37.223339 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:37.406905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:37.414842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:37.416380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:37.417489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-634ea3db-8bf8-4a18-b3e1-08cb4429dd3a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.207865 May 30 12:11:37.418037 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 374/718] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:37 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:38.435089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:38.435711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:38.442820 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.443276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.444078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:38.444518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:38.578514 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:38.586304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:38.587852 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:38.588954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ac5732eb-4c3c-475b-b65f-2d96f7ab3a16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.157690 May 30 12:11:38.589522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 345/719] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:38 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:39.607067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:39.607626 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:39.610095 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:39.615334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:39.615781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:39.616571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:39.617007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:39.748023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:39.755898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:39.757402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:39.758525 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2ee1b459-58f3-4fa5-8f76-91ea8683c993 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.155747 May 30 12:11:39.759083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 375/720] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:39 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:40.776685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:40.777302 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:40.784576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:40.785027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:40.785796 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:40.786234 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:40.913783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:40.925655 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:40.927412 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:40.928559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9cca0369-8d13-47f2-a6bb-fdcea7ca338d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.155816 May 30 12:11:40.929115 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 346/721] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:40 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:41.304642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-b46e4cb8-45cb-4a0f-99d9-23fd7f8f121e req-89c76e56-bfed-4474-a1df-46196dc0c5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "name": "network-vif-plugged", "status": "completed", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:41.315024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b46e4cb8-45cb-4a0f-99d9-23fd7f8f121e req-89c76e56-bfed-4474-a1df-46196dc0c5f9 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:41.315547 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b46e4cb8-45cb-4a0f-99d9-23fd7f8f121e req-89c76e56-bfed-4474-a1df-46196dc0c5f9 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:41.327835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-b46e4cb8-45cb-4a0f-99d9-23fd7f8f121e req-89c76e56-bfed-4474-a1df-46196dc0c5f9 service nova] Creating event network-vif-plugged:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:11:41.333161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-b46e4cb8-45cb-4a0f-99d9-23fd7f8f121e req-89c76e56-bfed-4474-a1df-46196dc0c5f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032810 May 30 12:11:41.334007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 376/722] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:41.946304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:41.946911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:41.948934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:41.949599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=8 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:41.956977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:41.957427 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:41.958227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:41.958695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:42.086226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:42.094155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:42.096436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:42.097547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4d4f6eea-25fe-44f7-8d68-b004512cb14e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.155132 May 30 12:11:42.098109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 347/723] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:41 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:42.644317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71d1df21-8717-4261-b143-27055954592f"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:42.645466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:42.652364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:42.652811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:42.653572 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:42.654008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.115064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:43.115688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:43.122245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:43.122702 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.123471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:43.123947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:43.256107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:43.264055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:43.265554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:43.267664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-07ab0d03-de7b-47d0-bbd3-0075fe984c66 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.156087 May 30 12:11:43.268261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 348/724] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:43 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:11:44.284939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:44.285569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:44.292057 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:44.292512 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:44.293285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:44.293723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:44.420039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:44.428858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:44.430352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:44.431442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-58384c2e-c72e-46d7-92f1-837b228e7d14 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.150477 May 30 12:11:44.432021 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 349/725] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:44 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:11:45.449297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:45.450253 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:45.459032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:45.459485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:45.460450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:45.461139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:45.599785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:45.608000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:45.609502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:45.611331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e7b01147-0938-4dcc-b46a-de365efd5ff5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1407 microversion: 2.20 time: 0.165809 May 30 12:11:45.611723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 350/726] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:45 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:45.635849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9c3c637d-719e-48e9-b542-3e5fddd5bec8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.995786 May 30 12:11:45.636620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 377/727] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:11:42 2022] POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments => generated 194 bytes in 2998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:46.629920 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:46.630564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:46.637014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.637464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.638222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.638662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.774725 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:46.782724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:46.784248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:46.785387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c0dc0128-5498-4b7d-96b2-d48e390d9128 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1600 microversion: 2.20 time: 0.159410 May 30 12:11:46.785949 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 351/728] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:11:46 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:11:46.803605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:46.804217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:46.810589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.811035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.811800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:46.812389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:46.894650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a62fec54-cd66-4d59-9315-4df1b54eb974 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095806 May 30 12:11:46.895262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 378/729] 10.222.0.41 () {60 vars in 1315 bytes} [Mon May 30 12:11:46 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:11:47.804738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-dc920444-f94a-4b98-b79d-b2b05035a8ad req-b6d08233-c24b-4638-abdd-badebd2fcf8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:47.814073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-dc920444-f94a-4b98-b79d-b2b05035a8ad req-b6d08233-c24b-4638-abdd-badebd2fcf8c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:47.814691 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-dc920444-f94a-4b98-b79d-b2b05035a8ad req-b6d08233-c24b-4638-abdd-badebd2fcf8c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:47.825851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-dc920444-f94a-4b98-b79d-b2b05035a8ad req-b6d08233-c24b-4638-abdd-badebd2fcf8c service nova] Creating event network-changed:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:11:47.831515 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-dc920444-f94a-4b98-b79d-b2b05035a8ad req-b6d08233-c24b-4638-abdd-badebd2fcf8c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030307 May 30 12:11:47.832311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 352/730] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:11:53.517389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:53.517929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:53.524563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.525021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.525786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:53.526221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:53.605809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lazy-loading 'services' on Instance uuid 640e40ad-15ab-48aa-acf1-4535e1343f69 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:53.678779 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6c63b7cd-1b51-4490-b358-9f76981d2b3d tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "DELETE /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69/os-volume_attachments/d09e366a-f7f2-43a8-bd69-aca6691878a2" status: 202 len: 0 microversion: 2.1 time: 0.165787 May 30 12:11:53.679651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 379/731] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:11:53 2022] DELETE /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69/os-volume_attachments/d09e366a-f7f2-43a8-bd69-aca6691878a2 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:11:57.362238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:11:57.363988 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:57.370887 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:57.371342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:57.372146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:57.372590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:57.397536 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'flavor' on Instance uuid 6b99e4e1-5f19-499c-b811-6516fb3019db {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:11:57.523581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-30e9117b-cd8e-4b34-b70b-44ec45b8bb28 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/action" status: 200 len: 32 microversion: 2.1 time: 0.165609 May 30 12:11:57.524220 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 353/732] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:11:57 2022] POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:11:57.533978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:57.535793 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:57.542405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:57.542855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:57.543603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:57.544062 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:57.684487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:57.693816 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7abfc43a-2bfc-4e10-8d15-e5c4c355bc21 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.164017 May 30 12:11:57.701149 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 380/733] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:57 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:58.712178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:58.712912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:58.715305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:11:58.721481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:58.722545 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:58.723321 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:58.723758 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:58.853258 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:58.861781 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da2bbfe2-d650-4f09-af46-35338920aa3a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.153848 May 30 12:11:58.863004 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 354/734] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:58 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:59.016233 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:59.016725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:59.024105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.024549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:59.025294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.025724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:59.051012 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:11:59.127121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2d0a7057-db7e-497a-9f14-5b52464c545b tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "DELETE /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 204 len: 0 microversion: 2.1 time: 0.113882 May 30 12:11:59.127797 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 381/735] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:11:59 2022] DELETE /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:11:59.136388 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:59.137032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:59.142965 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.144162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:59.145259 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.145695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:59.274542 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:11:59.281924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e04cf74d-9c24-4290-8be3-0faeb9c623ac tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1514 microversion: 2.1 time: 0.149408 May 30 12:11:59.282484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 355/736] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:59 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:11:59.880791 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:11:59.881492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:11:59.887448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.887924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:11:59.888689 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:11:59.889123 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:00.017907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:00.026545 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8ba3a444-6629-44b7-9f7b-6ec850a9a65d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.150671 May 30 12:12:00.027062 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 382/737] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:11:59 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:00.299750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:00.301599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:00.308570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:00.309031 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:00.309872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:00.310312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:00.324830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:00.448225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:00.455722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7caaa949-602b-42ca-a5ff-37f24134498f tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1514 microversion: 2.1 time: 0.160209 May 30 12:12:00.456926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 356/738] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:00 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:01.043424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:01.043963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:01.050953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.051394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.052182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.052610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.181321 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:01.189135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6d963be1-48dd-44fe-bed9-27bef4ceb23c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.149662 May 30 12:12:01.189708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 383/739] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:01 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:01.339421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:01.339953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:01.346043 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.347174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.348227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.348676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.371383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1cc75f1e-1daf-4f5b-a7ef-584d69d67c8f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/ips" status: 200 len: 149 microversion: 2.1 time: 0.089582 May 30 12:12:01.371948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 357/740] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:12:01 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/ips => generated 149 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:01.475353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:01.476136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:01.478070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:01.483755 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.484251 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.485018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:01.485454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:01.631741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:01.640132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-91fb3ae3-e22f-415b-85f9-c7db68f1fb4e tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1514 microversion: 2.1 time: 0.170362 May 30 12:12:01.640880 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 384/741] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:01 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:02.207481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:02.208251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:02.214572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.215020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.215802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.216266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.454506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:02.462708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f75f78f6-d2c6-4f9d-88a8-3b44c4adfcc0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.260043 May 30 12:12:02.463503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 358/742] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:02 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:02.615120 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-8cd693a9-ef73-4ff8-942f-6f7f72030d30 req-167ad120-30c2-4d25-83f4-ef00dccdf40c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "640e40ad-15ab-48aa-acf1-4535e1343f69", "name": "network-vif-deleted", "tag": "be6155ca-2caa-4280-a17e-39805fcc0dd8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:02.623751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8cd693a9-ef73-4ff8-942f-6f7f72030d30 req-167ad120-30c2-4d25-83f4-ef00dccdf40c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.624209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8cd693a9-ef73-4ff8-942f-6f7f72030d30 req-167ad120-30c2-4d25-83f4-ef00dccdf40c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.638108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-8cd693a9-ef73-4ff8-942f-6f7f72030d30 req-167ad120-30c2-4d25-83f4-ef00dccdf40c service nova] Creating event network-vif-deleted:be6155ca-2caa-4280-a17e-39805fcc0dd8 for instance 640e40ad-15ab-48aa-acf1-4535e1343f69 on hv-cinder-83979 May 30 12:12:02.643458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-8cd693a9-ef73-4ff8-942f-6f7f72030d30 req-167ad120-30c2-4d25-83f4-ef00dccdf40c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032022 May 30 12:12:02.643458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 385/743] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:02.660136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:02.660926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:02.667018 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.667571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.668724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.669167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.704298 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab3a83e2-35b0-4722-9faf-1450196ab857"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:02.705443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:02.712551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.713230 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.713841 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:02.714265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:02.740100 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbe77e4880a44d259fac8dfa05722f18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d363027ab254adfb4ba1b13de71d7e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:02.749650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1c201e63-ef2f-4d34-9769-13562a31bd86 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 200 len: 1304 microversion: 2.1 time: 0.094287 May 30 12:12:02.750095 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 359/744] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:02 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:03.227221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:03.351315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6e718948-9110-40e9-a53e-48c15dc580a2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650605 May 30 12:12:03.352025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 386/745] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:12:02 2022] POST /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments => generated 194 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:12:03.480698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:03.481314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:03.488075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:03.488528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:03.489293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:03.489733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:03.621230 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:03.629593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-de89adb9-b8c0-49a9-92a4-b432b36ee1d8 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.152866 May 30 12:12:03.630167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 360/746] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:03 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:03.767062 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:03.767756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] [instance: 640e40ad-15ab-48aa-acf1-4535e1343f69] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:03.776522 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:03.776650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:03.777315 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:03.777745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:03.791843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] HTTP exception thrown: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Request method failure captured: May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 HTTP/1.1 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLP9Y7K72sUNUiavXIOiYtazFuLtA_830fk-SOO3QK6-h3EMUlRbJqO1Ou3fnscfGno544FapUvH29AHTS2Yx9gDM5ROG38PPXWW4lDXInMA2to45kA2goAl7Oh-DmSVz8uADcnhb7c312N55TTU030t2SU_jDwfueminFl8JhNMOeA May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 4d363027ab254adfb4ba1b13de71d7e7 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:12:03.793414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4d363027ab254adfb4ba1b13de71d7e7", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4d363027ab254adfb4ba1b13de71d7e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 4d363027ab254adfb4ba1b13de71d7e7 May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-731724303 May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-VolumesSnapshotTestJSON-731724303-project May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: dbe77e4880a44d259fac8dfa05722f18 May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-VolumesSnapshotTestJSON-731724303-project May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. May 30 12:12:03.794958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '640e40ad-15ab-48aa-acf1-4535e1343f69'} May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:12:03.795878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. May 30 12:12:03.797332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:03.798474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] Returning 404 to user: Instance 640e40ad-15ab-48aa-acf1-4535e1343f69 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:12:03.798474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5b179b85-056a-48f2-a533-d7a5d0df8d40 tempest-VolumesSnapshotTestJSON-731724303 tempest-VolumesSnapshotTestJSON-731724303-project] 10.222.0.41 "GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69" status: 404 len: 111 microversion: 2.1 time: 0.032061 May 30 12:12:03.798474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 387/747] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:03 2022] GET /compute/v2.1/servers/640e40ad-15ab-48aa-acf1-4535e1343f69 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:12:04.646483 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:04.647075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:04.653522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:04.653974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:04.654732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:04.655168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:04.788760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:04.796825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9f9a001c-788c-4887-9afd-376704bafd1d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.154253 May 30 12:12:04.797394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 361/748] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:04 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:05.814634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:05.815323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:05.821842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:05.822291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:05.823052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:05.823490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:05.952761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:05.961171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-13005212-3890-4ea7-b90e-a99744337305 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.150379 May 30 12:12:05.961725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 388/749] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:05 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:06.978307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:06.979169 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:06.985631 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:06.986078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:06.986840 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:06.987518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:07.119136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:07.127078 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ce9cf528-b6e7-4855-92dd-927cef016141 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.152630 May 30 12:12:07.128218 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 362/750] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:06 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:08.145539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:08.146160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:08.152597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:08.153039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:08.153792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:08.154220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:08.284798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:08.292562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c429407f-38dc-4323-9933-6d7461555511 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.151751 May 30 12:12:08.293123 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 389/751] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:08 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:09.309351 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:09.309965 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:09.317357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:09.317814 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:09.318587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:09.319025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:09.453283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:09.462065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1c9a36c6-943f-40b3-80c2-a07a43ad9837 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.156620 May 30 12:12:09.462635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 363/752] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:09 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:10.479603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:10.480283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:10.487425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:10.488184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:10.488815 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:10.489254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:10.618580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:10.626355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e50f2b2f-e917-460c-90ee-e6cb4c744953 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.150835 May 30 12:12:10.626909 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 390/753] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:10 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:11.643866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:11.645594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:11.652041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:11.652487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:11.653238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:11.653668 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:11.781202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:11.789106 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-14eeb755-a48c-4b41-84fd-aa1f0d5e5ce1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.149079 May 30 12:12:11.789676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 364/754] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:11 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:12.080300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab3a83e2-35b0-4722-9faf-1450196ab857"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:12.081421 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:12.088845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.089353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.090193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.090640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.183926 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: POST /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments HTTP/1.1 May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 74 May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:12:12.185610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {"volumeAttachment": {"volumeId": "ab3a83e2-35b0-4722-9faf-1450196ab857"}} May 30 12:12:12.187000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'server_id': '330d9528-b5d4-4793-8273-6f08e7934f0a', 'body': {'volumeAttachment': {'volumeId': 'ab3a83e2-35b0-4722-9faf-1450196ab857'}}} May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:12.188100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:12.189235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:12.190365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:12.190365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:12:12.190365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:12:12.190365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a May 30 12:12:12.190365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:12.192829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 400 to user: Invalid volume: volume ab3a83e2-35b0-4722-9faf-1450196ab857 is already attached to instances: 330d9528-b5d4-4793-8273-6f08e7934f0a {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:12:12.193767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2bcee404-9f20-42b0-a9f6-55bb268b660a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117435 May 30 12:12:12.194416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 391/755] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:12:12 2022] POST /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 30 12:12:12.260457 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:12.261331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:12.268225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.268685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.270049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.271213 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.353185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'services' on Instance uuid 330d9528-b5d4-4793-8273-6f08e7934f0a {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:12:12.426685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-568e35c7-6a86-444b-9e9b-20ed42d150a6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments/ab3a83e2-35b0-4722-9faf-1450196ab857" status: 202 len: 0 microversion: 2.1 time: 0.169025 May 30 12:12:12.427273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 365/756] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:12:12 2022] DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments/ab3a83e2-35b0-4722-9faf-1450196ab857 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:12:12.435534 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:12.436540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:12.443659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.444236 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.444904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.445364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.476218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-54d18c9f-fd63-4213-bac2-db156ba5c73a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044420 May 30 12:12:12.476784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 392/757] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:12:12 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:12.808120 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:12.808827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:12.815024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.815479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.816278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:12.816771 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:12.946814 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:12.954843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7dc23051-7610-4da6-afbd-703fa00e0c44 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.151439 May 30 12:12:12.955437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 366/758] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:12 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:13.488426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:13.489387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:13.495794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:13.496293 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:13.497055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:13.497492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:13.528240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a972e526-82c4-4a99-9337-0f04f60534b8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 May 30 12:12:13.528867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 393/759] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:12:13 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:13.971413 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:13.971986 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:13.979015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:13.979471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:13.980281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:13.980826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.111861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:14.120439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-17c87b8c-caff-4250-b7a1-bc38189e6ce9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.153028 May 30 12:12:14.121005 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 367/760] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:13 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:14.540724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:14.541643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:14.548171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.548621 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.549383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.549826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.578784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2238e5c2-8894-435b-b234-b02ffce06e80 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042006 May 30 12:12:14.579336 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 394/761] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:12:14 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:12:14.636802 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:14.637303 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:14.643633 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.644130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.645027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.645471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.670401 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:12:14.744514 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-27ddadba-4e26-4a2f-8b8c-93dfb284d053 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 204 len: 0 microversion: 2.1 time: 0.111046 May 30 12:12:14.745018 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 368/762] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:12:14 2022] DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:12:14.753087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:14.753798 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:14.759657 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.760138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.760897 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:14.761322 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:14.887499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:14.895620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ff41063d-7422-498a-8329-24145baa0a17 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1681 microversion: 2.1 time: 0.146138 May 30 12:12:14.896246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 395/763] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:14 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:15.138307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:15.139012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:15.146306 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:15.146754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:15.147516 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:15.147984 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:15.278326 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:15.286373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3c904a3c-ec9a-46b5-95f6-8eddfce5118d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.152269 May 30 12:12:15.286936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 369/764] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:15 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:15.913342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:15.913988 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:15.920521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:15.920965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:15.921727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:15.922163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.055319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:16.062814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2eba5a47-92a8-4855-90e8-a50610e02834 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1681 microversion: 2.1 time: 0.153895 May 30 12:12:16.063391 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 396/765] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:15 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:16.303347 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:16.303923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:16.310329 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.310783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.311582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:16.312056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:16.445188 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:16.453204 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-441689ea-aafd-49ba-9e1b-f8eba76bd7ea tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.153851 May 30 12:12:16.453788 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 370/766] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:16 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:17.079955 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:17.080492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:17.087096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:17.087598 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:17.088393 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:17.088829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:17.217701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:17.225089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d51fcf32-e8f6-4f3e-b2f8-bc7c797367d8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1681 microversion: 2.1 time: 0.149085 May 30 12:12:17.225651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 397/767] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:17 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:17.470378 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:17.470913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:17.477525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:17.477980 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:17.479000 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:17.479442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:17.483423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:17.610984 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:17.619158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-db25c30f-02c7-4f7b-b271-7b40739ddeb1 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.152679 May 30 12:12:17.619733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 371/768] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:17 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:18.242390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:18.243007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:18.249437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.249887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.250651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.251088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.381009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:18.388774 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-de7bc051-8fe2-4a69-b963-94f918250823 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1681 microversion: 2.1 time: 0.150290 May 30 12:12:18.389357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 398/769] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:18 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:18.636310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:18.636841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:18.643216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.643670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.644487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:18.644938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:18.774810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:18.782716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a5d13739-4c05-493a-b9aa-65f5fbecf529 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.150370 May 30 12:12:18.783280 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 372/770] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:18 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:19.406598 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:19.407219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:19.414744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.415194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.415997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.416435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.548206 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:19.556214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5b0eab6b-4cfb-4aa6-a0a6-24842780225b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1681 microversion: 2.1 time: 0.153426 May 30 12:12:19.556796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 399/771] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:19 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:19.801950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:19.802562 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:19.809356 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.809846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.810605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:19.811034 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:19.944502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:19.952452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0f9a5168-eb22-4486-9b25-3a33b20399bf tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.155624 May 30 12:12:19.953020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 373/772] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:19 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:20.574998 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:20.575568 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:20.583045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.583542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:20.584391 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.584890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:20.650015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:20.657473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d8f98d34-9624-4a16-9a41-9610e6239004 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1613 microversion: 2.1 time: 0.086845 May 30 12:12:20.658049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 400/773] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:20 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1613 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:20.969794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:20.970414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:20.976853 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.977582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:20.978375 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:20.979071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.021632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-3ad443df-614b-4d49-bd49-7d80991a1bd2 req-dd9f0495-319c-4957-821b-df2043d4c577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "330d9528-b5d4-4793-8273-6f08e7934f0a", "name": "network-vif-deleted", "tag": "956d3b74-7d9f-4dd7-8797-fc4134242746"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:21.040014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-3ad443df-614b-4d49-bd49-7d80991a1bd2 req-dd9f0495-319c-4957-821b-df2043d4c577 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.052504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-3ad443df-614b-4d49-bd49-7d80991a1bd2 req-dd9f0495-319c-4957-821b-df2043d4c577 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.065289 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-3ad443df-614b-4d49-bd49-7d80991a1bd2 req-dd9f0495-319c-4957-821b-df2043d4c577 service nova] Creating event network-vif-deleted:956d3b74-7d9f-4dd7-8797-fc4134242746 for instance 330d9528-b5d4-4793-8273-6f08e7934f0a on hv-cinder-83979 May 30 12:12:21.077959 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-3ad443df-614b-4d49-bd49-7d80991a1bd2 req-dd9f0495-319c-4957-821b-df2043d4c577 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125219 May 30 12:12:21.083440 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 374/774] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:21.358934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:21.367865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-31c8eb5a-cb8f-430a-9f5f-7e252c593a00 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1733 microversion: 2.1 time: 0.401958 May 30 12:12:21.368453 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 401/775] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:20 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1733 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:21.676093 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:21.676926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:21.683425 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.683915 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.684700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.685207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.721268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:21.721722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:21.722179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'fault' on Instance uuid 330d9528-b5d4-4793-8273-6f08e7934f0a {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:12:21.777153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:21.785911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-db1f710e-02ed-40ea-a9f1-e3ca1ff8f7cd tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 200 len: 1331 microversion: 2.1 time: 0.114261 May 30 12:12:21.795688 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 375/776] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:21 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:22.386551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.393274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.407884 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.408385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.409290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.409691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.552550 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:22.560468 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3646373d-67ed-4929-9bc5-7e5d1b8a545e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1713 microversion: 2.1 time: 0.179086 May 30 12:12:22.561061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 402/777] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:22 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1713 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:22.618414 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.619041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.625471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.625928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.626689 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.627128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.708312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] HTTP exception thrown: Cannot 'detach_volume' instance 6b99e4e1-5f19-499c-b811-6516fb3019db while it is in vm_state rescued May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Request method failure captured: May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments/71d1df21-8717-4261-b143-27055954592f HTTP/1.1 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLOqXvhA33OE1KrBTW29-s8ZbGSa1aiF5pPu7DktUZ8_LbOI8Hn39-63aJdT9T9Ti28M4ay4x8coWhLWv89kBE0drMQGK5EzKVXQW45ir05Vyg4gUAAyZTN1FVBtRrV9bpM4-uYWindjSO-QiB5lXo4q9ogifQu6r8SICRlViZdBsEQ May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:12:22.709971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_66312b3f3f73477cbe27defa317537a4", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 4e875190d9dc48edb929bb316d5e576e May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:12:22.711559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Cannot 'detach_volume' instance 6b99e4e1-5f19-499c-b811-6516fb3019db while it is in vm_state rescued May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'server_id': '6b99e4e1-5f19-499c-b811-6516fb3019db', 'id': '71d1df21-8717-4261-b143-27055954592f'} May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db in vm_state rescued. Cannot detach_volume while the instance is in this state. May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:12:22.712460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6b99e4e1-5f19-499c-b811-6516fb3019db while it is in vm_state rescued May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6b99e4e1-5f19-499c-b811-6516fb3019db while it is in vm_state rescued May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.713924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Returning 409 to user: Cannot 'detach_volume' instance 6b99e4e1-5f19-499c-b811-6516fb3019db while it is in vm_state rescued {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:12:22.715085 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7557088c-8384-44d7-82cf-293028e1d0a9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments/71d1df21-8717-4261-b143-27055954592f" status: 409 len: 152 microversion: 2.1 time: 0.097190 May 30 12:12:22.715085 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 376/778] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:12:22 2022] DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments/71d1df21-8717-4261-b143-27055954592f => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 30 12:12:22.720558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:22.721095 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.730118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.730613 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.731395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.731853 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.735708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:22.800219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-576f0f35-463a-483c-868b-53381f685819 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/action" status: 202 len: 0 microversion: 2.1 time: 0.083394 May 30 12:12:22.804840 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 403/779] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:12:22 2022] POST /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:12:22.805015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.805568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.810800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.811526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:22.813443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.814026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.814908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.815476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.818251 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.818821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.819732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:22.820200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:22.830825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a HTTP/1.1 May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:12:22.832430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:12:22.834008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '330d9528-b5d4-4793-8273-6f08e7934f0a'} May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:12:22.834854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:12:22.836507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:12:22.837588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:12:22.837588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f2cd7ee1-3d07-4ab4-aa4e-94ee75b21e4c tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 404 len: 111 microversion: 2.1 time: 0.034120 May 30 12:12:22.837588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 377/780] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:22 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:12:22.843110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d7e6c201-eb54-40d0-b157-3e73d12efe7e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '.version_select at 0x7f61a1b3e430>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:22.861797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d7e6c201-eb54-40d0-b157-3e73d12efe7e tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512510492" status: 202 len: 0 microversion: 2.1 time: 0.022144 May 30 12:12:22.862472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 378/781] 10.222.0.41 () {58 vars in 1217 bytes} [Mon May 30 12:12:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512510492 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:12:22.960457 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:22.968485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3a271ecd-04e4-4406-a148-a315f9a874ef tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1721 microversion: 2.1 time: 0.162511 May 30 12:12:22.969050 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 404/782] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:22 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:23.859865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9f9a6747-81da-4619-8b47-812a512c4194 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: .version_select at 0x7f61a1b20940>, body: {"keypair": {"name": "tempest-keypair-1190236288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOduDidddbgUsQUOjZN9yPOG/o309Bbf6jb0hmpDqFmWuvEC7Cze9KYRxj9N0N3bck/AsWVYouxQFexw21ELZk5M2iU/6CDPwFJhlgm6RcajMfhjCCKdlab+A1zpxsO55Q=="}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:23.875380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-9f9a6747-81da-4619-8b47-812a512c4194 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:12:23.879927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-9f9a6747-81da-4619-8b47-812a512c4194 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'key_pairs'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:12:23.901645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9f9a6747-81da-4619-8b47-812a512c4194 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046203 May 30 12:12:23.902231 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 379/783] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:12:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:23.989624 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:23.990717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:23.997770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:23.998222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:23.999044 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:23.999484 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:24.151752 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:24.160411 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-92ced5d2-5fb2-4049-a361-da22a75310bb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1721 microversion: 2.1 time: 0.176742 May 30 12:12:24.161003 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 405/784] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:23 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:25.179028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:25.179704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:25.180866 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1661446611", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc42f6ba-36b7-432a-8fd7-6b1f2c279d11"}], "security_groups": [{"name": "tempest-securitygroup--2083570427"}], "key_name": "tempest-keypair-1190236288", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:25.186394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.186896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.187707 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.188217 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.289716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] validate_networks() for [('bc42f6ba-36b7-432a-8fd7-6b1f2c279d11', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:12:25.321606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:25.329628 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-555953b8-6806-42bb-99a6-34a77480225a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1721 microversion: 2.1 time: 0.155864 May 30 12:12:25.330203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 380/785] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:25 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:25.708780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:12:25.709927 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:12:25.710425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:12:25.710869 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:12:25.711291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:12:25.720022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.720474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.721312 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:25.721749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:25.738858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:12:25.742735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Getting quotas for user e12d075bc9144a5e8de3fe53004e9052 and project 74054e993c3a4c8794bb96540281f87d. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:12:25.753923 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:12:25.756294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:12:25.802695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ff2b7e4d-34bf-410f-9d21-93b76cad291b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627703 May 30 12:12:25.808170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 406/786] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:12:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:12:25.813263 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-dbe55c4d-6589-4e08-90a1-49ef505aa8cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:25.813876 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-dbe55c4d-6589-4e08-90a1-49ef505aa8cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:25.866861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dbe55c4d-6589-4e08-90a1-49ef505aa8cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:25.873580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-dbe55c4d-6589-4e08-90a1-49ef505aa8cc tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1242 microversion: 2.1 time: 0.064134 May 30 12:12:25.874149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 381/787] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:25 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:26.348052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:26.348751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:26.355705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.356177 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.357012 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.357437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.499183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:26.507563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-96f79c21-b7cf-4b88-8e5e-64fa7a9eb768 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1727 microversion: 2.1 time: 0.164305 May 30 12:12:26.508166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 407/788] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:26 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:26.523862 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:26.524355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:26.531130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.531585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.532398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.532841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.614026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2fbf693f-1fed-4e8e-b95a-d8ffb3a4d1bc tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093377 May 30 12:12:26.614736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 382/789] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:12:26 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:26.891378 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:26.892165 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:26.899962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.900513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.901416 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:26.901892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:26.969086 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:26.977433 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4fdd8bef-badd-404a-847b-f667aa9e26ba tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1302 microversion: 2.1 time: 0.090687 May 30 12:12:26.978016 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 408/790] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:26 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1302 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:27.998566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:28.002062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:28.013790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:28.014254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:28.015046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:28.016528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:28.126391 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:28.140478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0775dbda-3390-4648-b877-f5eaaeb364f6 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1300 microversion: 2.1 time: 0.147606 May 30 12:12:28.143548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 383/791] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:27 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:28.174582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-f08c8b0c-67c5-43c5-86a5-6673c45d1b70 req-bbc90292-a30e-426b-9c55-9cfe4c9c9229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:28.183745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-f08c8b0c-67c5-43c5-86a5-6673c45d1b70 req-bbc90292-a30e-426b-9c55-9cfe4c9c9229 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:28.184210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-f08c8b0c-67c5-43c5-86a5-6673c45d1b70 req-bbc90292-a30e-426b-9c55-9cfe4c9c9229 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:28.201873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-f08c8b0c-67c5-43c5-86a5-6673c45d1b70 req-bbc90292-a30e-426b-9c55-9cfe4c9c9229 service nova] Creating event network-changed:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:12:28.210277 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-f08c8b0c-67c5-43c5-86a5-6673c45d1b70 req-bbc90292-a30e-426b-9c55-9cfe4c9c9229 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039238 May 30 12:12:28.211138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 409/792] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:29.161739 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:29.162372 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:29.164429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:29.172923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:29.173239 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:29.174166 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:29.174606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:29.389690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:29.398613 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-02a76686-b700-4e6b-b5bb-2b5145cf8b3a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.242528 May 30 12:12:29.399316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 384/793] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:29 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:30.226135 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}, {"name": "network-changed", "server_uuid": "5bcbb825-7478-4165-a482-ea20ede5a5b2", "tag": "0f6f046c-2f1b-4f9e-92da-901ace4f7a8d"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:30.236082 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:30.236526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:30.248566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] Creating event network-changed:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:12:30.249070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] Creating event network-changed:0f6f046c-2f1b-4f9e-92da-901ace4f7a8d for instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 on hv-cinder-83979 May 30 12:12:30.255964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-2f8a14ba-de84-4807-8a38-0672cdf36b9a req-95a20edf-5884-4db5-bf14-5f751221da3e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033984 May 30 12:12:30.256528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 410/794] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:30.415828 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:30.416468 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:30.422937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:30.423386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:30.424177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:30.424618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:30.558566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:30.568255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a9ca11f6-5ff4-42d4-a4e3-349f7c9ecb68 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.156221 May 30 12:12:30.568979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 385/795] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:30 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:31.586128 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:31.586745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:31.589219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:31.594784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:31.595235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:31.596034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:31.596472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:31.729092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:31.736632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d0638002-21e2-4b3c-8594-f86a6569bbf8 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.155366 May 30 12:12:31.737197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 411/796] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:31 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:32.752856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:32.753481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:32.760525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:32.760972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:32.761726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:32.762161 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:32.892301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:32.900303 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-422f9958-d5a0-44b0-9051-50cde0d07560 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.151198 May 30 12:12:32.900933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 386/797] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:32 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:33.918163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:33.918780 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:33.926252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:33.926771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:33.927551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:33.928033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:34.063682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:34.071284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6199b0c0-a682-42c7-879e-8a0ac5e5ffac tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.157047 May 30 12:12:34.071868 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 412/798] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:33 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:34.607269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:34.607759 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:34.614118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:34.614561 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:34.615317 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:34.615751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:34.638890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-71cb91aa-7776-4fea-8d12-cd464bdfdc96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/ips" status: 200 len: 153 microversion: 2.20 time: 0.258016 May 30 12:12:34.639363 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 387/799] 10.222.0.41 () {60 vars in 1288 bytes} [Mon May 30 12:12:34 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/ips => generated 153 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:12:35.088402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:35.089040 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:35.095626 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:35.096186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:35.097969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:35.097969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:35.225732 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:35.233328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-055365d5-5ddf-4830-abc1-02cfe09bbb4a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.148862 May 30 12:12:35.233888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 413/800] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:35 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:35.587246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-5ce0446b-4b4a-416c-bb1b-4aade09e07d9 req-a7cbd085-469e-468b-80a8-a4a5635db229 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcbb825-7478-4165-a482-ea20ede5a5b2", "name": "network-vif-plugged", "status": "completed", "tag": "0f6f046c-2f1b-4f9e-92da-901ace4f7a8d"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:35.595608 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5ce0446b-4b4a-416c-bb1b-4aade09e07d9 req-a7cbd085-469e-468b-80a8-a4a5635db229 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:35.596090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5ce0446b-4b4a-416c-bb1b-4aade09e07d9 req-a7cbd085-469e-468b-80a8-a4a5635db229 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:35.607122 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-5ce0446b-4b4a-416c-bb1b-4aade09e07d9 req-a7cbd085-469e-468b-80a8-a4a5635db229 service nova] Creating event network-vif-plugged:0f6f046c-2f1b-4f9e-92da-901ace4f7a8d for instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 on hv-cinder-83979 May 30 12:12:35.612194 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-5ce0446b-4b4a-416c-bb1b-4aade09e07d9 req-a7cbd085-469e-468b-80a8-a4a5635db229 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093978 May 30 12:12:35.612776 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 388/801] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:36.250361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:36.250973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:36.252814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:36.254060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=6 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:36.261045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.261487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.262442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.262874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.313566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:36.318632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:36.319682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:36.326104 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.326550 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.327310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.327744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.357213 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7c574da1-e28e-43f7-8951-b56dbd836734 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044503 May 30 12:12:36.357781 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 389/802] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:12:36 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 30 12:12:36.400184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:36.407590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4242afa7-35b8-45d0-8941-ee74af10eee7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.161015 May 30 12:12:36.408213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 414/803] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:36 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:36.416748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:36.417254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:36.423207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.423661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.424467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.424913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.450237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:12:36.525551 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ebd5ea50-f40a-4519-9429-13f9ea55ae90 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 204 len: 0 microversion: 2.1 time: 0.112303 May 30 12:12:36.526135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 390/804] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:12:36 2022] DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:12:36.534575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:36.535931 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:36.541846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.542291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.543049 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.543485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.671651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:36.679569 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6bc498d1-e0a1-4e8a-b103-f7b6a0b9a388 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1675 microversion: 2.1 time: 0.148949 May 30 12:12:36.680177 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 415/805] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:36 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:12:36.744818 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:36.745439 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:36.751380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.751858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.752617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:36.753058 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:36.773290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:36.777945 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lazy-loading 'flavor' on Instance uuid 9290dd18-9781-4201-9574-355d6078a3b0 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:12:37.037833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6edd4a32-3250-4a3d-9bf7-826cc3cd37c4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/action" status: 202 len: 0 microversion: 2.20 time: 0.296938 May 30 12:12:37.038596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 391/806] 10.222.0.41 () {62 vars in 1318 bytes} [Mon May 30 12:12:36 2022] POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:12:37.046859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:37.047472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:37.053753 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.054210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.054978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.055420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.190220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.199141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.200704 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.201882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bb5a0df1-1333-4778-a2dc-0926e9552a3d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.158933 May 30 12:12:37.202441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 416/807] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:37 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:37.425064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:37.426783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:37.433371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.433828 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.434633 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.435081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.565681 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.574026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2a0a5587-a117-4665-b379-fe0d6d429c46 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1368 microversion: 2.1 time: 0.153157 May 30 12:12:37.574596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 392/808] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:37 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:37.696580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:37.697190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:37.703540 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.704015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.704764 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:37.705192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:37.835055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:37.842479 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dbcfed5d-15aa-4938-a231-11967f32c815 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1675 microversion: 2.1 time: 0.149657 May 30 12:12:37.843043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 417/809] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:37 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:38.219977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:38.220598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:38.227214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.227662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.228721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.229160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.360495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:38.368794 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:38.370292 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:38.371450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-81cb1c2a-832e-485b-abcd-a69d8ce1def2 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.155387 May 30 12:12:38.372010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 393/810] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:38 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:38.590590 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:38.591121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:38.597202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.597651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.598411 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.598848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.727307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:38.734919 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1ed84b39-a6fe-4c7f-920f-5ed3e0184071 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1558 microversion: 2.1 time: 0.148306 May 30 12:12:38.735481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 418/811] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:38 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:38.751202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:38.751700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:38.758834 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.759297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.760081 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.760520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.837640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-95dbf787-bda9-4a11-8359-51c8cd1d7238 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090156 May 30 12:12:38.838233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 394/812] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:12:38 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:38.859766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:38.860483 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:38.867158 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.867597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:38.868400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:38.868837 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:39.125026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:39.133953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-106e943f-c7c7-4ca9-a80b-6a50f1a8eb12 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1675 microversion: 2.1 time: 0.277930 May 30 12:12:39.134533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 419/813] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:38 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:39.389947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:39.391118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:39.398454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:39.399147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:39.400123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:39.400779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:39.637800 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:39.646995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:39.648548 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:39.649739 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-257b13df-4404-4689-869b-60b25f57e147 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.263761 May 30 12:12:39.650477 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 395/814] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:39 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:40.059384 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-73104bc8-76b8-4bea-a528-ddeb0ec53395 req-184783d9-2f5c-4581-a8f3-1da305499c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74de07ed-a2fe-45f8-ac09-ec21741046db", "name": "network-vif-deleted", "tag": "025b3ade-423e-4cd4-ba87-23078118b6b9"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:40.109890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-73104bc8-76b8-4bea-a528-ddeb0ec53395 req-184783d9-2f5c-4581-a8f3-1da305499c16 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.112170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-73104bc8-76b8-4bea-a528-ddeb0ec53395 req-184783d9-2f5c-4581-a8f3-1da305499c16 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:40.153867 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-73104bc8-76b8-4bea-a528-ddeb0ec53395 req-184783d9-2f5c-4581-a8f3-1da305499c16 service nova] Creating event network-vif-deleted:025b3ade-423e-4cd4-ba87-23078118b6b9 for instance 74de07ed-a2fe-45f8-ac09-ec21741046db on hv-cinder-83979 May 30 12:12:40.172132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-73104bc8-76b8-4bea-a528-ddeb0ec53395 req-184783d9-2f5c-4581-a8f3-1da305499c16 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127289 May 30 12:12:40.173220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 420/815] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:40.178487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:40.179196 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:40.194711 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.195168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:40.195984 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.196426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:40.215027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-b72f5541-6e3d-43bd-a0f8-816f98cc5fc7 req-4515b480-7188-44c0-8f7d-fcbcde9120e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bcbb825-7478-4165-a482-ea20ede5a5b2", "tag": "0f6f046c-2f1b-4f9e-92da-901ace4f7a8d"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:40.228814 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b72f5541-6e3d-43bd-a0f8-816f98cc5fc7 req-4515b480-7188-44c0-8f7d-fcbcde9120e4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.229655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:40.230131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b72f5541-6e3d-43bd-a0f8-816f98cc5fc7 req-4515b480-7188-44c0-8f7d-fcbcde9120e4 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:40.259939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-b72f5541-6e3d-43bd-a0f8-816f98cc5fc7 req-4515b480-7188-44c0-8f7d-fcbcde9120e4 service nova] Creating event network-changed:0f6f046c-2f1b-4f9e-92da-901ace4f7a8d for instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 on hv-cinder-83979 May 30 12:12:40.266846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-b72f5541-6e3d-43bd-a0f8-816f98cc5fc7 req-4515b480-7188-44c0-8f7d-fcbcde9120e4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140268 May 30 12:12:40.267612 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 396/816] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:40.321987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:40.332423 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c0c17530-2e21-4d62-907c-b1da89a6de5a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 200 len: 1323 microversion: 2.1 time: 0.157389 May 30 12:12:40.334011 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 421/817] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:40 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:40.668937 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:40.669635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:40.686687 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.688267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:40.693110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:40.694024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:41.163470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:41.173580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:41.175511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:41.177325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9ef4a3f2-e4ad-49ce-a82e-c243acd54605 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.512577 May 30 12:12:41.183380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 397/818] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:40 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:41.350733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:41.351959 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:41.358852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:41.359846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:41.360633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:41.361064 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:41.375676 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db HTTP/1.1 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:12:41.377509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:12:41.380221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '74de07ed-a2fe-45f8-ac09-ec21741046db'} May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:12:41.381174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:12:41.382682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:12:41.384833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:12:41.385698 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f1f781f4-cbb2-4226-a802-9e0d9e3c57b3 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 404 len: 111 microversion: 2.1 time: 0.039905 May 30 12:12:41.386260 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 422/819] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:41 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:12:41.397521 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e8942254-b242-46f5-a105-2629d53cb5da tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '.version_select at 0x7f61a1be90d0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:41.417642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e8942254-b242-46f5-a105-2629d53cb5da tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783926552" status: 202 len: 0 microversion: 2.1 time: 0.026424 May 30 12:12:41.418471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 398/820] 10.222.0.41 () {58 vars in 1220 bytes} [Mon May 30 12:12:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783926552 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:12:42.073987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ff1ec3b6-80f6-490b-b6bd-3738faef1ebd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: .version_select at 0x7f61a1a47040>, body: {"keypair": {"name": "tempest-keypair-2132768665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1AOgtrvXDIXBrgGDCW1Y4y0PWiF2kii5XfHCg/SDxxcD96Nc/xtSjXq0VADdIdXKeEX04T2JKjIiSZ5JFMxfVwN2STtUM8sb2LWHkLyEoOao7gIrxZtaVZviqKpEtAvA=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:42.087874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-ff1ec3b6-80f6-490b-b6bd-3738faef1ebd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for project 63d6c4272b654ba18d854527b14b1a88. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:12:42.091614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-ff1ec3b6-80f6-490b-b6bd-3738faef1ebd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for user 5ee1e385f10e4ed4849ef2febc22e497 and project 63d6c4272b654ba18d854527b14b1a88. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:12:42.114477 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ff1ec3b6-80f6-490b-b6bd-3738faef1ebd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044683 May 30 12:12:42.114992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 423/821] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:12:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:42.195273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:42.195958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:42.202832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:42.204062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:42.205062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:42.205527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:42.342383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:42.352206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:42.354625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:42.356593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2bdc6a42-d941-429b-914b-dc004c8b7824 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.165447 May 30 12:12:42.357494 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 399/822] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:42 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:43.351675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-955499067", "imageRef": "8a3d26f1-e2a9-4534-9268-345a40a719a0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fb58b71f-baeb-455b-a553-e207f4ef1e81"}], "security_groups": [{"name": "tempest-securitygroup--664282748"}], "key_name": "tempest-keypair-2132768665", "user_data": "}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:43.374866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:43.375554 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:43.383207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:43.383648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:43.384443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:43.384872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:43.460664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.network.neutron [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] validate_networks() for [('fb58b71f-baeb-455b-a553-e207f4ef1e81', None, None, None, None, None)] {{(pid=117705) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:12:43.525640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:43.533658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:43.535742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:43.537074 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9f69b6f6-6ce8-4e56-89b3-d2dccd3cd667 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.165969 May 30 12:12:43.537648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 400/823] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:43 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:12:43.826784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Flavor limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:12:43.827211 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Image limits 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:12:43.827685 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Flavor pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:12:43.828145 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Image pref 0:0:0 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:12:43.828561 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.virt.hardware [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117705) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:12:43.838026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:43.838478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:43.839285 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:43.839725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:43.856834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for project 63d6c4272b654ba18d854527b14b1a88. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:12:43.860753 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Getting quotas for user 5ee1e385f10e4ed4849ef2febc22e497 and project 63d6c4272b654ba18d854527b14b1a88. Resources: {'cores', 'ram', 'instances'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:12:43.872351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Going to run 1 instances... {{(pid=117705) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:12:43.874577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8a3d26f1-e2a9-4534-9268-345a40a719a0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117705) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:12:43.921190 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8cf4d0f6-4fa3-4168-9024-9d0f41da470d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.574392 May 30 12:12:43.921830 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 424/824] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:12:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:12:43.932176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9b335575-ac83-4c9f-a402-1f6f9a189c3c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:43.932791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9b335575-ac83-4c9f-a402-1f6f9a189c3c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:43.985943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9b335575-ac83-4c9f-a402-1f6f9a189c3c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:43.994279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9b335575-ac83-4c9f-a402-1f6f9a189c3c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1237 microversion: 2.1 time: 0.065841 May 30 12:12:43.994849 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 401/825] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:43 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:44.556291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:44.557350 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:44.568134 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:44.568941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:44.569982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:44.570722 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:44.701098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:44.709878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:44.711394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:44.712577 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5c0e5cf9-77a6-4a9b-96ba-878dccf41251 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.160960 May 30 12:12:44.713125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 425/826] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:44 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:45.011070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:45.011649 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:45.021244 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:45.021801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:45.022671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:45.023179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:45.089511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:45.099451 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4f8085bc-bfdc-4792-82a7-4b9aea935772 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1307 microversion: 2.1 time: 0.092521 May 30 12:12:45.100121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 402/827] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:45 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:45.731935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:45.733219 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:45.741096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:45.741804 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:45.742680 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:45.743286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:45.902224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:45.916512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:45.918031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:45.919223 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2c99f73a-e93f-4a0d-ac41-609f760adbd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.191703 May 30 12:12:45.919982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 426/828] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:45 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:46.117607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:46.118147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:46.124721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:46.125174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:46.125947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:46.126393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:46.328149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:46.336812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e9a000c3-09c7-4d34-a40a-cc1361cbb30f tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.223101 May 30 12:12:46.337727 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 403/829] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:46 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:46.607300 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-3a586663-8dca-4d42-88a3-16484eb900dc req-049c242a-0b30-4129-839b-9e6a9d3aecd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60235790-c023-4db4-947f-56e28cb40e1f", "tag": "bef31487-4449-4d57-923c-451900a21460"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:46.617207 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3a586663-8dca-4d42-88a3-16484eb900dc req-049c242a-0b30-4129-839b-9e6a9d3aecd0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:46.617544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-3a586663-8dca-4d42-88a3-16484eb900dc req-049c242a-0b30-4129-839b-9e6a9d3aecd0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:46.633834 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-3a586663-8dca-4d42-88a3-16484eb900dc req-049c242a-0b30-4129-839b-9e6a9d3aecd0 service nova] Creating event network-changed:bef31487-4449-4d57-923c-451900a21460 for instance 60235790-c023-4db4-947f-56e28cb40e1f on hv-cinder-83979 May 30 12:12:46.638607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-3a586663-8dca-4d42-88a3-16484eb900dc req-049c242a-0b30-4129-839b-9e6a9d3aecd0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035119 May 30 12:12:46.639380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 427/830] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:46.937423 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:46.938032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:46.944390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:46.945327 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:46.945658 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:46.946103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:47.137180 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:47.145823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:47.147408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:47.148601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-21332150-4644-4df2-ba07-14332268c3ab tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.215101 May 30 12:12:47.149163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 404/831] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:46 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:47.355217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:47.355967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:47.362065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:47.362519 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:47.363294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:47.363725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:47.497035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:47.505137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e2b21910-ca21-4762-81eb-e63bab8e688d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.154802 May 30 12:12:47.505716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 428/832] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:47 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:48.166467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:48.167086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:48.173571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:48.174027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:48.174793 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:48.175241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:48.306727 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:48.314722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:48.316773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:48.317958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c6ef3a6b-6ca9-4b5e-90b3-f59202601325 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.155412 May 30 12:12:48.318527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 405/833] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:48 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:48.521274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:48.521785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:48.528475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:48.528927 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:48.529691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:48.530137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:48.660009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:48.667335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e25752f6-b335-4745-b011-93e53c0d685d tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.150023 May 30 12:12:48.667923 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 429/834] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:48 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:49.336010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:49.336654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:49.343153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:49.343612 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:49.344412 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:49.344857 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:49.471621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:49.480568 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:49.482181 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:49.483340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-719d1072-49f4-4ff1-b7b2-9541087df767 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.151332 May 30 12:12:49.483923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 406/835] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:49 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:49.684119 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:49.684727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:49.691701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:49.692176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:49.692965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:49.693408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:49.829667 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:49.837706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4824eb18-257c-4a84-8f99-12fa5a750314 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.157647 May 30 12:12:49.838264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 430/836] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:49 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:50.501698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:50.502334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:50.511344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:50.511785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:50.512579 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:50.513014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:50.643398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:50.652054 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:50.653552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:50.654700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-06a50410-7841-49e6-a4da-59f8ea4de35a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.156970 May 30 12:12:50.655254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 407/837] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:50 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:50.854492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:50.855105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:50.861603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:50.862053 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:50.862957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:50.863485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:50.991406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:50.998810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d55aee2d-7b3c-4295-b068-38dcbb7706e5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.148413 May 30 12:12:50.999363 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 431/838] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:50 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:51.674369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:51.675545 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:51.682386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:51.682549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:51.683275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:51.683720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:51.818709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:51.826606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:51.828149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:51.829298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f80ca605-674e-4a6c-b2db-05b909c6d2fe tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.159053 May 30 12:12:51.829854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 408/839] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:51 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:52.014758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:52.015290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:52.021974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:52.022427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:52.023193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:52.023651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:52.157328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:52.166600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d6ce1d50-d2b3-429d-b7b4-039ff47f06d8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.155750 May 30 12:12:52.167170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 432/840] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:52 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:52.847850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:52.848455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:52.855517 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:52.856075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:52.856851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:52.857294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:52.859977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:52.986323 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:52.995138 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:52.996668 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:52.997806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-13b023ed-17b6-47c1-be04-a97022fcb710 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.154140 May 30 12:12:52.998353 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 409/841] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:52 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:53.183302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:53.183951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:53.190999 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:53.191466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:53.192261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:53.192695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:53.321633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:53.329201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-87dda573-0fdc-43ef-8a13-eefb27cbcbd1 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.149625 May 30 12:12:53.329858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 433/842] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:53 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:53.680016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-08a8105e-ee9f-4b63-a576-7d15e9142062 req-01d8c875-ef22-4dcd-a316-708aa28e8765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60235790-c023-4db4-947f-56e28cb40e1f", "name": "network-vif-plugged", "status": "completed", "tag": "bef31487-4449-4d57-923c-451900a21460"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:53.688096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-08a8105e-ee9f-4b63-a576-7d15e9142062 req-01d8c875-ef22-4dcd-a316-708aa28e8765 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:53.688578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-08a8105e-ee9f-4b63-a576-7d15e9142062 req-01d8c875-ef22-4dcd-a316-708aa28e8765 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:53.702104 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-08a8105e-ee9f-4b63-a576-7d15e9142062 req-01d8c875-ef22-4dcd-a316-708aa28e8765 service nova] Creating event network-vif-plugged:bef31487-4449-4d57-923c-451900a21460 for instance 60235790-c023-4db4-947f-56e28cb40e1f on hv-cinder-83979 May 30 12:12:53.707559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-08a8105e-ee9f-4b63-a576-7d15e9142062 req-01d8c875-ef22-4dcd-a316-708aa28e8765 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 May 30 12:12:53.708398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 410/843] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:54.016875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:54.017555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:54.021316 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:54.021964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=10 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:54.027173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:54.027634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:54.028431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:54.028873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:54.160600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:54.168596 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:54.170108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:54.171270 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-50da7120-efb8-46fb-98df-6672d6582f11 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.158337 May 30 12:12:54.171842 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 434/844] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:54 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:54.343452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:54.348301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:54.349037 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:54.355797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:54.356276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:54.357041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:54.357481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:54.485792 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:54.493752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-67dc1238-2977-4013-bbf7-ea79d3a77fca tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.151759 May 30 12:12:54.494306 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 411/845] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:54 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:55.189230 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:55.189876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:55.197022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:55.197471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:55.198237 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:55.198674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:55.328787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:55.336678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:55.338194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:55.339357 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-090e318b-4620-4222-a126-17b2adf497a8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1746 microversion: 2.20 time: 0.154008 May 30 12:12:55.339929 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 435/846] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:55 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:55.510307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:55.510946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:55.517619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:55.518065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:55.519420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:55.519882 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:55.655505 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:55.663593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e3f005fe-703a-464d-9e54-7676ef7d936e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1362 microversion: 2.1 time: 0.157074 May 30 12:12:55.664199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 412/847] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:55 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:56.357908 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:56.358519 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:56.365328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.365829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.366602 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.366989 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.494019 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:56.501749 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:56.503740 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:56.504922 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-62d670db-369c-4a94-aa46-ba81e82ab114 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1746 microversion: 2.20 time: 0.150921 May 30 12:12:56.505478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 436/848] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:56 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1746 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:56.681089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:56.681701 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:56.688297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.688748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.689510 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.689947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.817712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:56.825028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2954eb57-804c-4d59-9330-efe88e08108b tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1548 microversion: 2.1 time: 0.147815 May 30 12:12:56.825617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 413/849] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:56 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:56.841759 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:56.842257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:56.848360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.848810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.849579 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:56.850014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:56.927070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2bec44a0-0e33-4fd3-a23f-01ea378bec80 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089102 May 30 12:12:56.927684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 437/850] 10.222.0.41 () {58 vars in 1274 bytes} [Mon May 30 12:12:56 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:57.154587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:57.155091 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:57.161639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.162093 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.162864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.163305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.188350 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:12:57.265909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-00bfc213-1eee-40fa-90c6-390c09b5ca56 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 204 len: 0 microversion: 2.1 time: 0.114779 May 30 12:12:57.266803 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 414/851] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:12:57 2022] DELETE /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:12:57.275555 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:57.276213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:57.286724 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.287173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.287973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.288404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.523236 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:57.524005 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:57.530270 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.530726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.531506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:57.532149 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:57.533469 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:57.542915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bce8924d-2942-49cc-b622-723e58c89461 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1576 microversion: 2.1 time: 0.271132 May 30 12:12:57.543509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 438/852] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:57 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:57.676299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:57.685256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:57.687328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:57.688777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bd3561c5-81a9-4a68-991d-be3fb3fd1057 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1746 microversion: 2.20 time: 0.169970 May 30 12:12:57.689606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 415/853] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:57 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1746 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:12:58.191786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-b6bb6688-13ca-4d06-9637-4e0659b500d1 req-b784dd87-d471-4c47-a0b0-a07a004ee741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60235790-c023-4db4-947f-56e28cb40e1f", "tag": "bef31487-4449-4d57-923c-451900a21460"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:58.200115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b6bb6688-13ca-4d06-9637-4e0659b500d1 req-b784dd87-d471-4c47-a0b0-a07a004ee741 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:58.200558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b6bb6688-13ca-4d06-9637-4e0659b500d1 req-b784dd87-d471-4c47-a0b0-a07a004ee741 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:58.212299 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-b6bb6688-13ca-4d06-9637-4e0659b500d1 req-b784dd87-d471-4c47-a0b0-a07a004ee741 service nova] Creating event network-changed:bef31487-4449-4d57-923c-451900a21460 for instance 60235790-c023-4db4-947f-56e28cb40e1f on hv-cinder-83979 May 30 12:12:58.217241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-b6bb6688-13ca-4d06-9637-4e0659b500d1 req-b784dd87-d471-4c47-a0b0-a07a004ee741 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030126 May 30 12:12:58.218302 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 439/854] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:58.560773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:58.561298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:58.568717 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:58.569168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:58.569938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:58.570368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:58.708160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:58.708855 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:58.715509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:58.715989 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:58.716763 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:58.717192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:58.752642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:58.763617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2ee14221-35f2-42ce-84eb-a78d02054e02 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1576 microversion: 2.1 time: 0.206672 May 30 12:12:58.764241 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 416/855] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:58 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1576 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:12:58.866885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:58.874859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:58.876386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:12:58.877552 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-676b412d-a261-4739-805e-f4566860a283 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.174320 May 30 12:12:58.878321 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 440/856] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:58 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:12:59.756830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-d201ffe7-c921-4cf3-81fc-4f35300699f7 req-5b93d189-7887-4325-b6eb-1133b0d23680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "name": "network-vif-plugged", "status": "completed", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:12:59.767908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:12:59.775748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d201ffe7-c921-4cf3-81fc-4f35300699f7 req-5b93d189-7887-4325-b6eb-1133b0d23680 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:59.776369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-d201ffe7-c921-4cf3-81fc-4f35300699f7 req-5b93d189-7887-4325-b6eb-1133b0d23680 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:59.781563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:59.782183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:59.794012 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:59.805292 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:59.806533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:59.807146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:59.813853 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-d201ffe7-c921-4cf3-81fc-4f35300699f7 req-5b93d189-7887-4325-b6eb-1133b0d23680 service nova] Creating event network-vif-plugged:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:12:59.823931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-d201ffe7-c921-4cf3-81fc-4f35300699f7 req-5b93d189-7887-4325-b6eb-1133b0d23680 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075066 May 30 12:12:59.823931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 417/857] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:12:59.897128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:12:59.898085 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:12:59.905783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:59.906421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:12:59.907373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:12:59.908008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:00.095618 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:00.108262 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:00.110583 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:00.113073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-64ed9e16-d9de-4bad-b1ca-025c82b1f668 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.219824 May 30 12:13:00.115528 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 418/858] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:12:59 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:00.131797 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:00.141217 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-598f7b5f-67bd-4791-b1ff-d14c71dabd11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1576 microversion: 2.1 time: 0.363580 May 30 12:13:00.147612 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 441/859] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:12:59 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1576 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:00.532729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-400151ee-5a05-4920-88b7-cfb759b58265 req-fde5d11c-29a4-48dc-a764-e2433c6acd78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b", "name": "network-vif-deleted", "tag": "362343d9-e05b-46da-9e7b-f85cbc6ae1a1"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:00.543042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-400151ee-5a05-4920-88b7-cfb759b58265 req-fde5d11c-29a4-48dc-a764-e2433c6acd78 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:00.543912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-400151ee-5a05-4920-88b7-cfb759b58265 req-fde5d11c-29a4-48dc-a764-e2433c6acd78 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:00.558386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-400151ee-5a05-4920-88b7-cfb759b58265 req-fde5d11c-29a4-48dc-a764-e2433c6acd78 service nova] Creating event network-vif-deleted:362343d9-e05b-46da-9e7b-f85cbc6ae1a1 for instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b on hv-cinder-83979 May 30 12:13:00.572075 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-400151ee-5a05-4920-88b7-cfb759b58265 req-fde5d11c-29a4-48dc-a764-e2433c6acd78 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043023 May 30 12:13:00.577475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 419/860] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:01.133169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:01.135162 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:01.149900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:01.150622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:01.151623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:01.153137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:01.166869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:01.168171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:01.174666 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:01.175324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:01.176343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:01.176942 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:01.182407 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:01.216397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:01.217141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:01.217756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lazy-loading 'fault' on Instance uuid 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:01.269705 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:01.278445 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-879a36a9-0482-40ca-a21f-c5762ecc6bf5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 200 len: 1230 microversion: 2.1 time: 0.116136 May 30 12:13:01.279799 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 420/861] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:01 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 1230 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:01.341794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:01.358974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:01.363409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:01.365501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-19923f0b-07d9-45cd-8d02-6847724ef26f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.236764 May 30 12:13:01.390882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 442/862] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:01 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:02.297287 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:02.298625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:02.307065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:02.307851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:02.308714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:02.309046 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:02.325452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] HTTP exception thrown: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Request method failure captured: May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b HTTP/1.1 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLPaiUo-iZsI3esD_Btcj0msMfUq7z2Im8pUhaM79a_hdPprYsxdvvKz16SA4GVq0dWoP5PbqNXVudvKetykpubpYnqQuaucjY7YZ1n6N_EKadx65M0W2XlMA-a8WsewJJek9lJjcGAd0_aaR9SCZC1zmH-yEWz_C82wSNkMsy9Cmo8 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:13:02.327325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4249e846c5d54876a6ed97678450c1d2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestVolumeBootPattern-1448383181 May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestVolumeBootPattern-1448383181-project May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: f7e7ce32b4c0457196c8765d6c5ada7e May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestVolumeBootPattern-1448383181-project May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:13:02.328880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b'} May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:02.329865 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:13:02.331998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:02.333670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Returning 404 to user: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:02.333670 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1e87b195-c6ef-44e1-afec-aa030f24514d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 404 len: 111 microversion: 2.1 time: 0.036083 May 30 12:13:02.340564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 421/863] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:02 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:02.391491 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:02.392759 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:02.400218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:02.403775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:02.404606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:02.408102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:02.408374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:02.515879 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2123980453", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261961072", "security_groups": [{"name": "tempest-secgroup-smoke-784746195"}], "block_device_mapping_v2": [{"uuid": "44f57024-cae0-4d37-82fc-e27b4e52635f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc16439-b142-4833-aa53-bbb0e6914ce9"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:02.580772 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:02.590004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:02.591533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:02.593252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ee6c391f-4997-44e1-a8f7-41cae3bec716 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.208841 May 30 12:13:02.593690 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 443/864] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:02 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:02.652301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] validate_networks() for [('acc16439-b142-4833-aa53-bbb0e6914ce9', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:13:03.415256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:13:03.415839 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:13:03.416253 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:13:03.416669 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:13:03.417089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:13:03.427370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:03.427841 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:03.428671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:03.429112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:03.447421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:13:03.451921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for user f7e7ce32b4c0457196c8765d6c5ada7e and project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:13:03.518847 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:13:03.521348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44f57024-cae0-4d37-82fc-e27b4e52635f',volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:13:03.616434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:03.617643 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:03.627036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:03.629344 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:03.631679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:03.632163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:03.696379 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a49c4423-dc85-4a83-8de3-6370c8a06d73 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.186426 May 30 12:13:03.697894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 422/865] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:13:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 30 12:13:03.709777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-48edeb2a-b1e2-4b01-8257-70fb8a99f389 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:03.711652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-48edeb2a-b1e2-4b01-8257-70fb8a99f389 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:03.821020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-48edeb2a-b1e2-4b01-8257-70fb8a99f389 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:03.841417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:03.845998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-48edeb2a-b1e2-4b01-8257-70fb8a99f389 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1094 microversion: 2.1 time: 0.132857 May 30 12:13:03.848187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 423/866] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:03 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1094 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:03.860047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:03.861599 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:03.868447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cfd7affa-11e8-46a5-87fc-a4f75842036e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.258830 May 30 12:13:03.879187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 444/867] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:03 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:04.866169 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:04.867518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:04.876538 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:04.877442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:04.878470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:04.879127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:04.889529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:04.890437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:04.911223 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:04.911670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:04.914170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:04.914616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:04.969106 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:04.981487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-269fe13d-5d32-459a-8efa-aebcf1b10355 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1192 microversion: 2.1 time: 0.120856 May 30 12:13:04.982601 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 424/868] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:04 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1192 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:05.168148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:05.183214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:05.192449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:05.193687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b7e09c25-199f-4604-91a3-32cb35f8c796 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.310991 May 30 12:13:05.194259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 445/869] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:04 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:06.000206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:06.001387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:06.017473 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.019931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.020966 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.021584 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.129224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:06.130085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:06.159132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.162310 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.172090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.172858 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.423602 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'services' on Instance uuid 6b99e4e1-5f19-499c-b811-6516fb3019db {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:06.425476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:06.445902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-59aacc06-4aaf-4131-aa65-36e141f82ea2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1277 microversion: 2.1 time: 0.450583 May 30 12:13:06.455392 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 425/870] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:05 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1277 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:06.484856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:06.485820 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:06.497485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.498172 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.499227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.499976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.635799 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6ec344c3-631f-41ae-a4a5-8afd5885d050 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments/71d1df21-8717-4261-b143-27055954592f" status: 202 len: 0 microversion: 2.1 time: 0.522755 May 30 12:13:06.636924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 446/871] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:13:06 2022] DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments/71d1df21-8717-4261-b143-27055954592f => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:06.649041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:06.652200 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:06.668977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.675945 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.676876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:06.677433 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:06.733830 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a1c3cbf2-e9ab-43b2-b6c8-2792513974d5 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092294 May 30 12:13:06.735007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 447/872] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:06 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:06.996654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:07.008615 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:07.010130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:07.011314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5fa7b271-a749-44f5-bc55-30e2bd61d60b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.553488 May 30 12:13:07.041854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 426/873] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:06 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:07.261647 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-ad049b8f-1017-4838-8145-616a8cefb812 req-5cf8a04f-4451-4b19-a30a-c3bdbc2a267f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd07025-c284-41b4-89d5-fb7f33d3cce3", "tag": "c093c7fc-4dd4-4446-8948-0ee7b0bc65bd"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:07.272342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ad049b8f-1017-4838-8145-616a8cefb812 req-5cf8a04f-4451-4b19-a30a-c3bdbc2a267f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:07.272785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-ad049b8f-1017-4838-8145-616a8cefb812 req-5cf8a04f-4451-4b19-a30a-c3bdbc2a267f service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:07.284383 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-ad049b8f-1017-4838-8145-616a8cefb812 req-5cf8a04f-4451-4b19-a30a-c3bdbc2a267f service nova] Creating event network-changed:c093c7fc-4dd4-4446-8948-0ee7b0bc65bd for instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 on hv-cinder-83979 May 30 12:13:07.307458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-ad049b8f-1017-4838-8145-616a8cefb812 req-5cf8a04f-4451-4b19-a30a-c3bdbc2a267f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047808 May 30 12:13:07.308741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 448/874] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:07.473822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:07.474647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:07.491549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:07.499064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:07.500442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:07.507728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:07.697443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:07.705340 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f97d9372-e99f-445e-b303-c3fd84c2eb2d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.236977 May 30 12:13:07.706305 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 427/875] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:07 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:07.746571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:07.747983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:07.755426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:07.756252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:07.757360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:07.758006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:07.793374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-51d55167-db38-4943-8f7f-7a74845be7c9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051051 May 30 12:13:07.795573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 449/876] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:07 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:08.030835 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:08.031973 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:08.040566 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.041159 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.042005 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.042606 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.046294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:08.204891 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:08.214721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:08.216581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:08.218182 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0424eb82-d98e-4c90-88ec-865d8232746b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.192095 May 30 12:13:08.219214 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 428/877] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:08 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:08.723560 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:08.724175 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:08.730981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.731434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.732240 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.732675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.806517 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:08.807902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:08.814397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.815264 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.816294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.816736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.850775 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c37e65d9-e73c-406b-a2dd-ab8008f09d17 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048150 May 30 12:13:08.857176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 429/878] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:08 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:13:08.885706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:08.894320 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e8face71-0f75-4bea-bae4-e2d542c0547f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.175389 May 30 12:13:08.895496 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 450/879] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:08 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:08.933387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:08.934189 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:08.941352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.941811 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.942596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:08.943041 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:08.970599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:13:09.082522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a9178ec6-fe48-4599-adc0-faa77e37aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 204 len: 0 microversion: 2.1 time: 0.152655 May 30 12:13:09.083180 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 430/880] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:08 2022] DELETE /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:09.091633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:09.094314 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:09.101746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.102385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:09.104069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.104678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:09.239687 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:09.240616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:09.252610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.253475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:09.254625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.255288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:09.263126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:09.272876 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e60c8c13-4099-4333-903a-3857be06c937 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1687 microversion: 2.1 time: 0.185531 May 30 12:13:09.273462 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 451/881] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:09 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:09.414953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:09.426829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:09.428382 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:09.429864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-32b99411-2642-4564-b8cd-585e7310823f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.195392 May 30 12:13:09.430430 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 431/882] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:09 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:09.910961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:09.911603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:09.918324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.918771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:09.919527 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:09.920002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:10.053235 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:10.060725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-92028425-d60c-4a5a-ad5b-f01872e769b5 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.154176 May 30 12:13:10.061291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 452/883] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:09 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:10.390953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:10.391578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:10.398198 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:10.398657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:10.399442 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:10.399913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:10.449232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:10.449847 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:10.456697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:10.456914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:10.457679 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:10.458112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:10.535377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:10.543144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a2cd2bf0-92cf-41d2-a2ac-d6ea6032aad0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1687 microversion: 2.1 time: 0.256679 May 30 12:13:10.543930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 432/884] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:10 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1687 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:10.589918 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:10.598716 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:10.600323 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:10.601520 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-05759757-c2de-4b85-bdbd-794b11c1d24b tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.156522 May 30 12:13:10.602076 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 453/885] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:10 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:11.077896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:11.078502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:11.085011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.085456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.086209 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.086642 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.214701 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:11.222180 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-dcb4c721-2da8-40f2-b71f-93c0ab9dfefb tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.148155 May 30 12:13:11.222732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 433/886] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:11 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:11.560036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:11.560651 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:11.568634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.569082 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.569844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.570280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.619133 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:11.620131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:11.626542 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.626991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.627788 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:11.628258 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:11.701503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:11.710225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-40c6f183-b879-40b1-b405-f4768683e331 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1687 microversion: 2.1 time: 0.154025 May 30 12:13:11.710803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 454/887] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:11 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:11.760672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:11.769407 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:11.770934 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:11.772148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-27bbd28e-f7bc-49b8-9da1-73daa758d80a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.156940 May 30 12:13:11.772699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 434/888] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:11 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:12.239753 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:12.240401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:12.246472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.246909 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.247659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.248108 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.382185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:12.389556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6bcfe30f-9c8d-4262-9065-9ccb7c7c1aa4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.154048 May 30 12:13:12.390125 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 455/889] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:12 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:12.727014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:12.727939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:12.734470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.734925 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.735697 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.736171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.790767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:12.791374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:12.797891 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.798331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.799684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:12.800709 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:12.866184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:12.873892 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ab0f8ed8-f389-47e0-b79f-b89dfbe31740 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1687 microversion: 2.1 time: 0.150762 May 30 12:13:12.874470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 435/890] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:12 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:12.931262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:12.939202 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:12.940977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:12.942143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5c9487a0-7ab3-46bc-aece-a024d64af933 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1741 microversion: 2.20 time: 0.155351 May 30 12:13:12.942703 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 456/891] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:12 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1741 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:13.407695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:13.408355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:13.415020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.415472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:13.416267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.416710 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:13.436935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:13.553474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:13.560949 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a228b6c8-eba7-4ba8-a7c8-b34cb684061b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.158036 May 30 12:13:13.561894 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 436/892] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:13 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:13.890533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:13.891204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:13.899231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.899765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:13.900648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.901146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:13.964437 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:13.966303 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:13.970373 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=8 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:13.976394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.977010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:13.978371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:13.979250 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:14.126731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:14.138003 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-749171b5-3831-4ab1-9eef-3193dd57abd2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1687 microversion: 2.1 time: 0.250808 May 30 12:13:14.138599 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 457/893] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:13 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1687 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:14.163722 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:14.172089 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:14.173609 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:14.174878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-23459e45-3929-401f-b3dd-c83b84d88d8f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1723 microversion: 2.20 time: 0.218174 May 30 12:13:14.175645 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 437/894] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:13 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:14.579307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:14.579956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:14.586844 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:14.587291 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:14.588079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:14.588541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:14.821658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:14.824167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:14.831103 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dd0e9b24-d1c7-4d54-8251-5d00c29934c1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.255208 May 30 12:13:14.832352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 458/895] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:14 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:15.052361 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-1dfc7ed4-e8cf-4e37-a91a-73c05b4ff751 req-5204285c-a2f4-4bd5-ae14-c53b2a2184a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b99e4e1-5f19-499c-b811-6516fb3019db", "name": "network-vif-deleted", "tag": "b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:15.062989 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-1dfc7ed4-e8cf-4e37-a91a-73c05b4ff751 req-5204285c-a2f4-4bd5-ae14-c53b2a2184a7 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.063527 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-1dfc7ed4-e8cf-4e37-a91a-73c05b4ff751 req-5204285c-a2f4-4bd5-ae14-c53b2a2184a7 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.075992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-1dfc7ed4-e8cf-4e37-a91a-73c05b4ff751 req-5204285c-a2f4-4bd5-ae14-c53b2a2184a7 service nova] Creating event network-vif-deleted:b4ccd203-481a-44e0-8bc2-3ed0fd0c2fe9 for instance 6b99e4e1-5f19-499c-b811-6516fb3019db on hv-cinder-83979 May 30 12:13:15.082748 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-1dfc7ed4-e8cf-4e37-a91a-73c05b4ff751 req-5204285c-a2f4-4bd5-ae14-c53b2a2184a7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036017 May 30 12:13:15.083895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 438/896] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:15.157478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:15.160252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:15.169226 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.170359 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.171532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.176071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.196562 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:15.197189 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:15.211347 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.213315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.215167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.215652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.293396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:15.304410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9ed0d904-fbed-44e6-9566-b5fe99d6f927 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1328 microversion: 2.1 time: 0.151518 May 30 12:13:15.316409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 459/897] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:15 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1328 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:15.398324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:15.406455 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:15.407998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:15.409204 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3bc1aa19-553a-4756-ab26-e74f1a625e8a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1723 microversion: 2.20 time: 0.219371 May 30 12:13:15.410054 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 439/898] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:15 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:15.848882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:15.849536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:15.856098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.856556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.857331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:15.857768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:15.998368 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:16.006259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5e02ecc5-b369-4b4e-a581-1a1d1ff0f5d9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.161463 May 30 12:13:16.006831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 460/899] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:15 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:16.332653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:16.333270 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:16.339779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:16.340258 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:16.341062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:16.341502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:16.372662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:16.373110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:16.373553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 6b99e4e1-5f19-499c-b811-6516fb3019db {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:16.418221 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:16.426012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a6e1a901-af39-4bc0-a764-0ad41e4f7bd9 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1333 microversion: 2.1 time: 0.097759 May 30 12:13:16.426590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 440/900] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:16 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1333 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:16.428424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:16.429037 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:16.435490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:16.435983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:16.436744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:16.437179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:16.565758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:16.573938 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:16.575432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:16.576614 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-43b52928-2d29-46b7-902d-9068f9413bac tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1723 microversion: 2.20 time: 0.152280 May 30 12:13:16.577173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 461/901] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:16 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:17.022712 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:17.023255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:17.029344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.029805 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.030581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.031023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.163245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:17.170639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9b2b217d-c10c-4432-b612-19ca3b18a2c4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.151913 May 30 12:13:17.171200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 441/902] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:17 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:17.442935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:17.443554 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:17.450148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.450607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.451369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.451809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.482432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.482882 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.483327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 6b99e4e1-5f19-499c-b811-6516fb3019db {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:17.523580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:17.530991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5d7fabb9-bc04-4993-b11f-bad75476864d tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 200 len: 1333 microversion: 2.1 time: 0.092168 May 30 12:13:17.531557 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 462/903] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:17 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:17.594298 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:17.594897 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:17.602203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.602908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.603662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.604148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.748101 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:17.757718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:17.759235 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:17.760449 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a1102b28-3a89-4428-94a8-04f994f0d7b0 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1723 microversion: 2.20 time: 0.169979 May 30 12:13:17.773155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 442/904] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:17 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:17.878861 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-e1b29a00-c9c8-4804-9a7d-bf746fd268b9 req-f3a7dfa2-0aef-4e69-8d4a-40808b0efb08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "name": "network-vif-unplugged", "status": "completed", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:17.888395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-e1b29a00-c9c8-4804-9a7d-bf746fd268b9 req-f3a7dfa2-0aef-4e69-8d4a-40808b0efb08 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:17.888912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-e1b29a00-c9c8-4804-9a7d-bf746fd268b9 req-f3a7dfa2-0aef-4e69-8d4a-40808b0efb08 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:17.901148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-e1b29a00-c9c8-4804-9a7d-bf746fd268b9 req-f3a7dfa2-0aef-4e69-8d4a-40808b0efb08 service nova] Creating event network-vif-unplugged:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:13:17.905953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-e1b29a00-c9c8-4804-9a7d-bf746fd268b9 req-f3a7dfa2-0aef-4e69-8d4a-40808b0efb08 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031158 May 30 12:13:17.906634 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 463/905] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:18.187920 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:18.188540 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:18.194621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.195071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.195868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.196313 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.211254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:18.335386 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:18.342946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6554ad17-37ae-4fe6-bbb3-fb498fba486f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.158909 May 30 12:13:18.343512 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 443/906] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:18 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:18.549575 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:18.550221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 6b99e4e1-5f19-499c-b811-6516fb3019db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:18.556903 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.557354 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.558132 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.558569 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.573192 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] HTTP exception thrown: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Request method failure captured: May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db HTTP/1.1 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLOqXvhA33OE1KrBTW29-s8ZbGSa1aiF5pPu7DktUZ8_LbOI8Hn39-63aJdT9T9Ti28M4ay4x8coWhLWv89kBE0drMQGK5EzKVXQW45ir05Vyg4gUAAyZTN1FVBtRrV9bpM4-uYWindjSO-QiB5lXo4q9ogifQu6r8SICRlViZdBsEQ May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:18.574887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_66312b3f3f73477cbe27defa317537a4", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 4e875190d9dc48edb929bb316d5e576e May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. May 30 12:13:18.576273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '6b99e4e1-5f19-499c-b811-6516fb3019db'} May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:18.577008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. May 30 12:13:18.578348 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:18.579394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Returning 404 to user: Instance 6b99e4e1-5f19-499c-b811-6516fb3019db could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:18.579394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c9707914-876a-4e4e-9fbe-43c73c48eb70 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db" status: 404 len: 111 microversion: 2.1 time: 0.031882 May 30 12:13:18.579394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 464/907] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:18 2022] GET /compute/v2.1/servers/6b99e4e1-5f19-499c-b811-6516fb3019db => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:18.585911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6e084169-814d-4d57-a9ea-981a4f549696 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '.version_select at 0x7f61a1b08790>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:18.604290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6e084169-814d-4d57-a9ea-981a4f549696 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22730253" status: 202 len: 0 microversion: 2.1 time: 0.022209 May 30 12:13:18.604988 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 444/908] 10.222.0.41 () {58 vars in 1214 bytes} [Mon May 30 12:13:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22730253 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:18.789427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:18.790223 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:18.796390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.796888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.797599 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.798060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.933078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:18.942262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:18.943755 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:18.945032 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-736e7955-81fd-483c-8a3d-79761868d508 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1666 microversion: 2.20 time: 0.165551 May 30 12:13:18.945587 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 465/909] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:18 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1666 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:18.963184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6caf89-3fb3-4ce6-8b02-c857a0c82f22"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:18.964293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:18.971734 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.972476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:18.973261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:18.973696 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.266552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e7d7a3ed-5c3a-46ad-8d7d-2f0cf2d69346 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307356 May 30 12:13:19.267454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 445/910] 10.222.0.41 () {62 vars in 1363 bytes} [Mon May 30 12:13:18 2022] POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 30 12:13:19.360617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:19.361182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.367941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.368387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.369146 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.369578 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.386507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:19.387013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.393760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.394215 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.395048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.395434 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.508113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:19.516035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f847934d-3dd1-4976-b368-a45287eb8973 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.159389 May 30 12:13:19.519850 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 466/911] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:19 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:19.649084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a1460d77-b46a-4683-b139-6faa2c52c63a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments/1f6caf89-3fb3-4ce6-8b02-c857a0c82f22" status: 202 len: 0 microversion: 2.20 time: 0.266395 May 30 12:13:19.649720 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 446/912] 10.222.0.41 () {60 vars in 1456 bytes} [Mon May 30 12:13:19 2022] DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments/1f6caf89-3fb3-4ce6-8b02-c857a0c82f22 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 30 12:13:19.706160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:19.706784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.713229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.713681 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.714443 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.714883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.797077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-628c76b6-6fcb-4a20-8f40-518eab87abaf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/action" status: 202 len: 0 microversion: 2.20 time: 0.094907 May 30 12:13:19.797698 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 467/913] 10.222.0.41 () {62 vars in 1318 bytes} [Mon May 30 12:13:19 2022] POST /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:19.806484 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:19.807114 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:19.817532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.818238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.819284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.819753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.927362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-c4301f2b-606b-4001-b244-4e336e5aa1aa req-3965112a-f328-4f89-8408-0012e2a34a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd07025-c284-41b4-89d5-fb7f33d3cce3", "name": "network-vif-plugged", "status": "completed", "tag": "c093c7fc-4dd4-4446-8948-0ee7b0bc65bd"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:19.937061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-c4301f2b-606b-4001-b244-4e336e5aa1aa req-3965112a-f328-4f89-8408-0012e2a34a95 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:19.937727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-c4301f2b-606b-4001-b244-4e336e5aa1aa req-3965112a-f328-4f89-8408-0012e2a34a95 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:19.950512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-c4301f2b-606b-4001-b244-4e336e5aa1aa req-3965112a-f328-4f89-8408-0012e2a34a95 service nova] Creating event network-vif-plugged:c093c7fc-4dd4-4446-8948-0ee7b0bc65bd for instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 on hv-cinder-83979 May 30 12:13:19.957100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-c4301f2b-606b-4001-b244-4e336e5aa1aa req-3965112a-f328-4f89-8408-0012e2a34a95 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 May 30 12:13:19.957751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 468/914] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:20.007728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:20.017014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:20.021846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:20.023806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5c341bdd-2367-40d5-b43d-088e3ce9aa69 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1674 microversion: 2.20 time: 0.221270 May 30 12:13:20.024920 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 447/915] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:19 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1674 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:20.533041 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:20.533965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:20.540279 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:20.540719 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:20.541478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:20.541915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:20.675886 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:20.683373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c50d8293-bea8-43cf-a1a6-713b5f704b2b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.154451 May 30 12:13:20.683967 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 469/916] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:20 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:21.043001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.043549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.050328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.050786 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.051552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.052049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.180196 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:21.188104 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:21.190163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:21.191721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-50e77d9d-ca17-48c7-a52a-ccd87ac65e56 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.152508 May 30 12:13:21.192329 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 448/917] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:21 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:21.503169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.503683 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.510031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.510475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.511225 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.511655 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.536751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:13:21.612565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-febb28fb-9a65-4eba-9fe8-2a504061907b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 204 len: 0 microversion: 2.1 time: 0.113108 May 30 12:13:21.613195 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 470/918] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:21 2022] DELETE /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:21.621211 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.621826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.628467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.628924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.630064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.630507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.700995 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:21.701698 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:21.708126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.708574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.709341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:21.709811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:21.768050 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:21.779135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-16cc12eb-13b4-4429-843e-17b82bfed48a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1507 microversion: 2.1 time: 0.161686 May 30 12:13:21.779858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 449/919] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:21 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:21.872246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:21.880767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f170ec7e-f44d-4ca1-867a-3fb4a3619244 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1265 microversion: 2.1 time: 0.184005 May 30 12:13:21.881328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 471/920] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:21 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:22.211992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:22.212614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:22.219218 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.219672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.220483 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.221061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.350877 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:22.359086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:22.360639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:22.362441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-55bfb7de-7f3f-45e0-a00e-3e3440ad35c8 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.154438 May 30 12:13:22.363014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 450/921] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:22 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:22.797563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:22.798213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:22.805342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.805789 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.806558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.806987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.897680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:22.898296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:22.904334 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.904792 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.905569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:22.906010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:22.934996 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:22.943116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-58a6fa6b-6960-4b6e-8eba-328e3e90925a tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1507 microversion: 2.1 time: 0.149361 May 30 12:13:22.943691 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 472/922] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:22 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:23.035699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.043464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-605ce5c0-3760-42a5-a367-e18419bcbead tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1451 microversion: 2.1 time: 0.149438 May 30 12:13:23.044061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 451/923] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:22 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:23.059583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:23.060259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:23.067286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.067733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.068528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.068968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.200077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.207633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3d0ac2f0-9f89-4a52-8800-08421b96eaa2 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1451 microversion: 2.1 time: 0.151858 May 30 12:13:23.208226 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 473/924] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:23 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:23.380631 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:23.381295 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:23.383623 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:23.389873 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.390332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.391117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.391560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.527764 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.535938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.537448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:23.538709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7e8a8a09-128b-4c2d-94ca-f50e2f60f81e tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.162202 May 30 12:13:23.539394 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 452/925] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:23 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:23.960403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:23.961004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:23.967204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.967650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.968482 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:23.968913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:23.984576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:24.176702 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:24.184114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-42df57a2-4dc9-4879-861d-f11b29c1ca7c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1507 microversion: 2.1 time: 0.228022 May 30 12:13:24.184668 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 474/926] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:23 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:24.556524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:24.557146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:24.563807 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:24.564343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:24.565823 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:24.566312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:24.759785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:24.772827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:24.774355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:24.775553 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-19db24ce-a719-4af4-ba36-a2049c378395 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.222911 May 30 12:13:24.776141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 453/927] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:24 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:25.063259 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:25.065222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:25.071969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.072426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.073229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.073671 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.099454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a1dc9f36-30d1-4053-a056-1101c838ef61 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/ips" status: 200 len: 150 microversion: 2.1 time: 0.040304 May 30 12:13:25.105521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 475/928] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:13:25 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:25.201588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:25.202611 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:25.210232 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.210818 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.211694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.212255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.429300 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:25.438474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-865af142-0656-465e-b470-488e0b3f5c49 req-715a4022-4ce7-4941-988e-c6b4428f5a8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd07025-c284-41b4-89d5-fb7f33d3cce3", "tag": "c093c7fc-4dd4-4446-8948-0ee7b0bc65bd"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:25.440465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9ec7c970-fdc4-4103-addd-0dc006797cda tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1507 microversion: 2.1 time: 0.242129 May 30 12:13:25.450792 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 454/929] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:25 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1507 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:25.466693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-865af142-0656-465e-b470-488e0b3f5c49 req-715a4022-4ce7-4941-988e-c6b4428f5a8c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.467171 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-865af142-0656-465e-b470-488e0b3f5c49 req-715a4022-4ce7-4941-988e-c6b4428f5a8c service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.489303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-865af142-0656-465e-b470-488e0b3f5c49 req-715a4022-4ce7-4941-988e-c6b4428f5a8c service nova] Creating event network-changed:c093c7fc-4dd4-4446-8948-0ee7b0bc65bd for instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 on hv-cinder-83979 May 30 12:13:25.496604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-865af142-0656-465e-b470-488e0b3f5c49 req-715a4022-4ce7-4941-988e-c6b4428f5a8c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064867 May 30 12:13:25.497538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 476/930] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:25.796035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:25.797319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:25.809989 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.810754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:25.812791 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:25.821474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:26.076638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:26.080233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:26.085757 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:26.093106 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:26.094605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ba5fed38-80c1-4d43-a734-59d73a487677 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.302495 May 30 12:13:26.097224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 455/931] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:25 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:26.458688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:26.460047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:26.468215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:26.468934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:26.469972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:26.473264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:26.511848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:26.512303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:26.512794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:26.587501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:26.592966 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26827ebb-b43d-4c48-9c36-6ff5bf795ba8"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:26.594454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:26.597304 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d7911d3f-d600-4c6d-9c94-40210c25f9cb tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.143921 May 30 12:13:26.598059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 477/932] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:26 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:26.604231 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:26.605112 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:26.606155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:26.606756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.115327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:27.115969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:27.121937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.122380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.123136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.123573 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.257289 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:27.265463 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:27.267051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:27.268572 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f96afaca-c36b-48e2-9443-e6be7e2ae58a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.157970 May 30 12:13:27.269126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 478/933] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:27 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:27.552920 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-cee34ab7-6e7e-41fc-8fca-4a8e9db91c8b req-2e124782-fde2-420b-b030-b7d1e4858b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cbe4311-a6a8-45e5-9074-875b07bf7166", "name": "network-vif-deleted", "tag": "75435eb2-71bc-4e5e-bea5-27ad5c995b1d"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:27.563429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-cee34ab7-6e7e-41fc-8fca-4a8e9db91c8b req-2e124782-fde2-420b-b030-b7d1e4858b6e service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.564239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-cee34ab7-6e7e-41fc-8fca-4a8e9db91c8b req-2e124782-fde2-420b-b030-b7d1e4858b6e service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.577687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-cee34ab7-6e7e-41fc-8fca-4a8e9db91c8b req-2e124782-fde2-420b-b030-b7d1e4858b6e service nova] Creating event network-vif-deleted:75435eb2-71bc-4e5e-bea5-27ad5c995b1d for instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 on hv-cinder-83979 May 30 12:13:27.583233 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-cee34ab7-6e7e-41fc-8fca-4a8e9db91c8b req-2e124782-fde2-420b-b030-b7d1e4858b6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034007 May 30 12:13:27.583910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 479/934] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:27.614865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:27.615631 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:27.623050 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.623633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.624507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.625023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.661368 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:27.661816 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:27.662263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:27.709052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:27.716674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3b136d27-167a-45a2-9567-afed12765b07 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.106034 May 30 12:13:27.717246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 480/935] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:27 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:28.287952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:28.288654 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:28.294774 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:28.295376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:28.296174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:28.296615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:28.463021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:28.471991 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:28.473726 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:28.474920 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d8159566-4d33-49d0-ae68-5794c6283333 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.191991 May 30 12:13:28.475531 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 481/936] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:28 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:28.734355 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:28.735029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:28.741714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:28.742169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:28.742936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:28.743373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:28.778583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:28.778583 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:28.778943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:28.824770 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:28.833741 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6357fb5d-afa6-4ec6-aa60-acb47b3a2339 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.103357 May 30 12:13:28.834599 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 482/937] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:28 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:29.493745 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:29.494265 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:29.500419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:29.500871 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:29.502213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:29.502654 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:29.645878 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:29.653849 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:29.655376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:29.656574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-adb5b740-bd19-42f6-a25d-95e6a41bfd15 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.166822 May 30 12:13:29.657334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 483/938] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:29 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:29.850717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:29.852162 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:29.859090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:29.859543 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:29.860332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:29.860765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:29.893535 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:29.895890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:29.896344 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:29.896905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:29.942375 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:29.951648 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0ed91422-8087-4bd9-b954-baa42e494b05 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.104753 May 30 12:13:29.952474 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 484/939] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:29 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:30.675364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:30.676014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:30.682101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:30.682552 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:30.683326 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:30.683767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:30.823079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:30.834810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:30.836466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:30.837800 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-7e9ffcb1-8758-444c-afb2-10367e101bd5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.167103 May 30 12:13:30.838447 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 485/940] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:30 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:30.968121 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:30.968802 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:30.976270 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:30.976703 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:30.977743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:30.978184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:31.011649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:31.012143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:31.012604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:31.060275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:31.068537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ec9d56ac-7fc6-4ced-b722-2a931828e74f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.104415 May 30 12:13:31.069114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 486/941] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:30 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:31.856730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:31.857592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:31.864176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:31.864630 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:31.865409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:31.865860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:32.022781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:32.032009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:32.034319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:32.035546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-406a5cfe-facd-49a5-a893-b6bd8ecf60c5 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.183151 May 30 12:13:32.036426 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 487/942] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:31 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:32.085843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:32.086505 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:32.092730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:32.093204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:32.093961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:32.094403 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:32.129607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:32.130063 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:32.130522 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:32.173607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:32.182107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-38ad0439-92cf-4da3-bfa0-48b613b12d24 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.100063 May 30 12:13:32.182700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 488/943] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:32 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:33.054974 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:33.055744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:33.062574 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:33.063042 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:33.063839 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:33.064290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:33.207186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:33.215237 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:33.216751 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:33.217914 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cb0f33cb-ea19-40aa-9291-707b465c918c tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.167006 May 30 12:13:33.218682 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 489/944] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:33 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:33.227432 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:33.228078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:33.234374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:33.234843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:33.235744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:33.236275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:33.269305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:33.269757 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:33.270218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:33.272001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=100 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:33.317786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:33.325827 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-750c47f2-e9c6-49d9-b150-d3220877ce4b tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.102345 May 30 12:13:33.326517 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 490/945] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:33 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:34.236958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:34.237731 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:34.244241 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:34.244695 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:34.245466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:34.245906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:34.397899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:34.406044 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:34.407562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:34.409610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9eaaf158-6ded-4663-91cb-14fb60c889a1 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.176865 May 30 12:13:34.415425 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 491/946] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:34 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:34.420692 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:34.421493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:34.428704 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:34.429253 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:34.430096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:34.430593 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:34.464442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:34.464901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:34.465340 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:34.511294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:34.519078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1e70d307-9a4a-4e50-881b-9328312cd093 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.102313 May 30 12:13:34.519642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 492/947] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:34 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:35.427696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:35.428388 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:35.434756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:35.435201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:35.435999 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:35.436434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:35.571697 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:35.581409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:35.582906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:35.584088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1d33ca59-1623-424c-b60e-e0f9b0475087 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.160364 May 30 12:13:35.584638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 493/948] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:35 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:35.594763 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:35.595427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:35.605172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:35.605622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:35.606386 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:35.606829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:35.639174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:35.639737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:35.640247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid 5cbe4311-a6a8-45e5-9074-875b07bf7166 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:35.679780 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4d5b22bb-43b8-4ae7-b61d-1deb2891c4b2 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "POST /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.091070 May 30 12:13:35.680533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 456/949] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:13:26 2022] POST /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments => generated 194 bytes in 9093 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:35.688937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:35.696781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5d1ba1db-b188-4036-9153-cebed337a7e2 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 200 len: 1312 microversion: 2.1 time: 0.111174 May 30 12:13:35.697352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 494/950] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:35 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:36.604211 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:36.604910 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:36.606808 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=9 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:36.612911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.613365 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.614131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.614569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.714054 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:36.714875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: 5cbe4311-a6a8-45e5-9074-875b07bf7166] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:36.729142 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.729688 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.730592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.741401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.771154 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] HTTP exception thrown: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Request method failure captured: May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 HTTP/1.1 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLOqXvhA33OE1KrBTW29-s8ZbGSa1aiF5pPu7DktUZ8_LbOI8Hn39-63aJdT9T9Ti28M4ay4x8coWhLWv89kBE0drMQGK5EzKVXQW45ir05Vyg4gUAAyZTN1FVBtRrV9bpM4-uYWindjSO-QiB5lXo4q9ogifQu6r8SICRlViZdBsEQ May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:36.779659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_66312b3f3f73477cbe27defa317537a4", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 4e875190d9dc48edb929bb316d5e576e May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. May 30 12:13:36.781114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '5cbe4311-a6a8-45e5-9074-875b07bf7166'} May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:36.781953 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. May 30 12:13:36.785460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:36.787346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Returning 404 to user: Instance 5cbe4311-a6a8-45e5-9074-875b07bf7166 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:36.787346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4abd607b-1f5a-4cab-a4b1-7e085d90b890 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166" status: 404 len: 111 microversion: 2.1 time: 0.070986 May 30 12:13:36.787791 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 495/951] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:36 2022] GET /compute/v2.1/servers/5cbe4311-a6a8-45e5-9074-875b07bf7166 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:13:36.796911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:36.797646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:36.805520 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.806231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.807186 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.807785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.835359 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:13:36.845338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:36.855765 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:36.857315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:36.858503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-79ed4413-7fe9-4610-855b-48f180311ea4 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.259417 May 30 12:13:36.859065 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 457/952] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:36 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:36.938488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9bf1f702-1d6c-4858-9882-5f222568a5c4 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "DELETE /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 204 len: 0 microversion: 2.1 time: 0.149099 May 30 12:13:36.940083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 496/953] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:36 2022] DELETE /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:36.948512 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:36.949131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:36.955844 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.956441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:36.957257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:36.957703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:37.097998 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:37.105843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cf903e5f-ef93-4545-acc9-2fc694228b2e tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.161328 May 30 12:13:37.106352 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 458/954] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:36 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:37.878814 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:37.879508 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:37.885637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:37.886079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:37.886836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:37.887264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:38.027360 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:38.036035 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:38.037551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:38.038786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c56d91a1-3920-4800-8bd1-0107a5dfc01f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.164944 May 30 12:13:38.039340 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 497/955] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:37 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:38.123610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:38.124285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:38.130810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:38.131261 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:38.132063 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:38.132506 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:38.260269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:38.268938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-751f678f-237e-4283-bbc9-2d7a88b221c3 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.148410 May 30 12:13:38.269282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 459/956] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:38 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:13:39.056901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:39.057520 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:39.064073 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:39.064529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:39.065358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:39.065796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:39.194408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:39.202319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:39.203807 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:39.204987 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f23cf983-e49f-42cc-9483-8d2f015ee334 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.152005 May 30 12:13:39.206116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 498/957] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:39 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:39.285530 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:39.286144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:39.292634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:39.293088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:39.293848 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:39.294290 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:39.429181 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:39.443495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f7c7e278-de90-406e-af71-3f2206019476 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.158770 May 30 12:13:39.444685 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 460/958] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:39 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:40.014875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-9552730e-2a5a-4c70-8113-77388247d562 req-83905a3c-4cc1-46a0-ae59-ef8cee558a84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "name": "network-vif-plugged", "status": "completed", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:40.023806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-9552730e-2a5a-4c70-8113-77388247d562 req-83905a3c-4cc1-46a0-ae59-ef8cee558a84 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:40.024313 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-9552730e-2a5a-4c70-8113-77388247d562 req-83905a3c-4cc1-46a0-ae59-ef8cee558a84 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:40.036456 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-9552730e-2a5a-4c70-8113-77388247d562 req-83905a3c-4cc1-46a0-ae59-ef8cee558a84 service nova] Creating event network-vif-plugged:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:13:40.041439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-9552730e-2a5a-4c70-8113-77388247d562 req-83905a3c-4cc1-46a0-ae59-ef8cee558a84 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030211 May 30 12:13:40.042067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 499/959] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:40.223296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:40.223955 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:40.230222 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:40.230676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:40.231443 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:40.231908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:40.363185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:40.371097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:40.372683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:40.373832 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7419b373-aa0b-4763-82a8-a3edfaf8399a tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.154637 May 30 12:13:40.374393 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 461/960] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:40 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:40.462566 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:40.463396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:40.471298 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:40.472039 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:40.472806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:40.473243 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:40.605795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:40.613915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-36effe25-fe59-4c2d-927e-c434089f3b59 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1520 microversion: 2.1 time: 0.155618 May 30 12:13:40.614481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 500/961] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:40 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:41.223028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:41.223534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:41.229936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.230390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.231227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.231662 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.258607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-8ed67698-4dfe-4b0e-9730-4bc2eee9766c req-338460a8-4d5b-47d4-9b07-d05cb712de0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2484e75-927b-450d-9638-6e57fc7f7e32", "name": "network-vif-deleted", "tag": "f625410d-dd8f-48af-bb65-d7cac1e77379"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:41.267503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8ed67698-4dfe-4b0e-9730-4bc2eee9766c req-338460a8-4d5b-47d4-9b07-d05cb712de0a service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.269026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8ed67698-4dfe-4b0e-9730-4bc2eee9766c req-338460a8-4d5b-47d4-9b07-d05cb712de0a service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.280413 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-8ed67698-4dfe-4b0e-9730-4bc2eee9766c req-338460a8-4d5b-47d4-9b07-d05cb712de0a service nova] Creating event network-vif-deleted:f625410d-dd8f-48af-bb65-d7cac1e77379 for instance d2484e75-927b-450d-9638-6e57fc7f7e32 on hv-cinder-83979 May 30 12:13:41.285419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-8ed67698-4dfe-4b0e-9730-4bc2eee9766c req-338460a8-4d5b-47d4-9b07-d05cb712de0a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030531 May 30 12:13:41.286013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 501/962] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:41.314124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'services' on Instance uuid 5bcbb825-7478-4165-a482-ea20ede5a5b2 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:41.385661 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-289e2ff7-224b-4aed-bd1c-7fd7b5eb27b4 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments/26827ebb-b43d-4c48-9c36-6ff5bf795ba8" status: 202 len: 0 microversion: 2.1 time: 0.167127 May 30 12:13:41.386549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 462/963] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:13:41 2022] DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments/26827ebb-b43d-4c48-9c36-6ff5bf795ba8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:13:41.394052 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:41.394754 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:41.395415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:41.396531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:41.401140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.401542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.402312 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.402692 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.402803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.403144 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.403962 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.404407 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.437095 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-55f2f0f5-87c0-4aad-b800-106c26626a27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046359 May 30 12:13:41.437664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 463/964] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:41 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:13:41.550025 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:41.559257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:41.561001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:41.562293 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b5c4e499-1b07-43b5-82fe-c9fc8a592a96 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.173230 May 30 12:13:41.563066 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 502/965] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:41 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 30 12:13:41.632492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:41.633119 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:41.639433 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.639924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.640711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.641150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.674513 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:41.675337 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:41.675453 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid d2484e75-927b-450d-9638-6e57fc7f7e32 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:41.721249 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:41.728969 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-631bfe73-379b-4a29-808c-4c3976ffb88c tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1311 microversion: 2.1 time: 0.100426 May 30 12:13:41.729539 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 464/966] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:41 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:42.449564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:42.450495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:42.457625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.458078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.458851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.459293 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.489080 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-60015d97-ac98-4826-a1f7-185d41480c16 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 May 30 12:13:42.489631 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 503/967] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:42 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:42.582266 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:42.582881 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:42.589479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.589954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.590716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.591162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.718953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:42.728481 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:42.730616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:42.731842 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-21d8429a-383e-4340-b2ec-ffcd211b00cf tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.154259 May 30 12:13:42.732416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 465/968] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:42 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:42.746350 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:42.746963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:42.753476 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.753932 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.754696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.755140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.786400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:42.786853 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:42.787303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid d2484e75-927b-450d-9638-6e57fc7f7e32 {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:42.831758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:42.839138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4d19e08c-ca58-45e5-9625-aadc0161dd2f tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1311 microversion: 2.1 time: 0.096612 May 30 12:13:42.839708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 504/969] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:42 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:43.500316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:43.501275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:43.507804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.508324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.509094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.509539 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.539237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4e85482a-91e6-48f6-a776-c0986be9075b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 May 30 12:13:43.539717 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 466/970] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:43 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:43.750157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:43.750767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:43.757767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.758254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.759031 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.759471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.855958 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:43.856938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:43.863604 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.864098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.864971 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.865411 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.899492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:43.900284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:43.900939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lazy-loading 'fault' on Instance uuid d2484e75-927b-450d-9638-6e57fc7f7e32 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:43.913284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:43.924427 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:43.925943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:43.927182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-01197ac6-753a-4bef-b26c-1da264b85b43 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1732 microversion: 2.20 time: 0.180969 May 30 12:13:43.927950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 505/971] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:43 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:43.943122 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e875190d9dc48edb929bb316d5e576e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66312b3f3f73477cbe27defa317537a4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:43.951064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-aa248253-dea9-47a5-9353-da12abbba3c0 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 200 len: 1311 microversion: 2.1 time: 0.099206 May 30 12:13:43.951639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 467/972] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:43 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:44.551465 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:44.552424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:44.558511 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.558961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.559730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.560197 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.575408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:44.592181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e14e84e9-3af1-45e6-8592-8f8cb39eb488 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045517 May 30 12:13:44.592737 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 506/973] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:44 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:13:44.651738 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:44.652264 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:44.659147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.659621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.660413 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.660848 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.684861 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:13:44.718890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:13:44.762703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b8e67234-b3f0-4b83-a8d1-dd541e655098 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 204 len: 0 microversion: 2.1 time: 0.114466 May 30 12:13:44.763508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 468/974] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:44 2022] DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:13:44.773157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:44.773885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:44.782373 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.782831 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.784218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.784845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.913371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:44.920813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5b5cc958-e725-4f36-bd0d-738386a0afa7 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1683 microversion: 2.1 time: 0.152944 May 30 12:13:44.921379 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 507/975] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:44 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:44.947111 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:44.947833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:44.954232 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.954711 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.955639 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.956135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.968610 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:44.969221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] [instance: d2484e75-927b-450d-9638-6e57fc7f7e32] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:44.976081 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.976678 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.977733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:44.978173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:44.992098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] HTTP exception thrown: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Request method failure captured: May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 HTTP/1.1 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLOqXvhA33OE1KrBTW29-s8ZbGSa1aiF5pPu7DktUZ8_LbOI8Hn39-63aJdT9T9Ti28M4ay4x8coWhLWv89kBE0drMQGK5EzKVXQW45ir05Vyg4gUAAyZTN1FVBtRrV9bpM4-uYWindjSO-QiB5lXo4q9ogifQu6r8SICRlViZdBsEQ May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:44.993785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_66312b3f3f73477cbe27defa317537a4", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/66312b3f3f73477cbe27defa317537a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 66312b3f3f73477cbe27defa317537a4 May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-492702726 May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 4e875190d9dc48edb929bb316d5e576e May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-ServerRescueNegativeTestJSON-492702726-project May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. May 30 12:13:44.995311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'd2484e75-927b-450d-9638-6e57fc7f7e32'} May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:44.996275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. May 30 12:13:44.998001 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:44.999499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] Returning 404 to user: Instance d2484e75-927b-450d-9638-6e57fc7f7e32 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:44.999499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3781d06e-e471-401d-9cb1-ee0b09e29105 tempest-ServerRescueNegativeTestJSON-492702726 tempest-ServerRescueNegativeTestJSON-492702726-project] 10.222.0.41 "GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32" status: 404 len: 111 microversion: 2.1 time: 0.030339 May 30 12:13:44.999499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 508/976] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:44 2022] GET /compute/v2.1/servers/d2484e75-927b-450d-9638-6e57fc7f7e32 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:45.094953 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:45.104912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:45.106530 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:45.107716 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a670673f-7e73-42f9-84c6-4ba1f401f19d tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1719 microversion: 2.20 time: 0.164900 May 30 12:13:45.108311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 469/977] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:13:44 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:13:45.250492 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:45.251070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:45.257324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:45.257774 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:45.258538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:45.258973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:45.281815 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-72aeeaef-a974-4d18-a32a-5eb1ffc1f52a tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.035101 May 30 12:13:45.282380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 509/978] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:13:45 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:45.938531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:45.939153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:45.945637 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:45.946088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:45.946859 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:45.947297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:46.078008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:46.087219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-526edb7a-857f-479d-8eae-4352a3769a54 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1683 microversion: 2.1 time: 0.152511 May 30 12:13:46.088348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 470/979] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:45 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:46.614106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ada5cd74-9926-4407-88be-79cf455d8cf4"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:46.615331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:46.622517 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:46.623258 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:46.624143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:46.624649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:47.107930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:47.108556 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:47.115644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:47.116129 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:47.117108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:47.117551 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:47.264424 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:47.272643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b15ca9da-11cb-4f30-89f8-65b3ef0e0312 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1683 microversion: 2.1 time: 0.168783 May 30 12:13:47.273610 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 471/980] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:47 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:47.648078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-64d30f9f-7274-4d74-b78e-f9084715e086 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039416 May 30 12:13:47.648656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 510/981] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:13:46 2022] POST /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:48.290471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:48.291098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:48.301892 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:48.302436 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:48.303160 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:48.303598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:48.443657 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:48.460531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8186e3ae-f012-4e3a-a955-6691eca7beb1 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1615 microversion: 2.1 time: 0.173718 May 30 12:13:48.471236 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 472/982] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:48 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1615 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:49.011948 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-27e40ba7-2154-4711-850b-d2d161d7de1a req-aa313518-bcee-4f2b-910b-2ca3743aed44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bcbb825-7478-4165-a482-ea20ede5a5b2", "name": "network-vif-deleted", "tag": "0f6f046c-2f1b-4f9e-92da-901ace4f7a8d"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:49.028936 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-27e40ba7-2154-4711-850b-d2d161d7de1a req-aa313518-bcee-4f2b-910b-2ca3743aed44 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:49.032907 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-27e40ba7-2154-4711-850b-d2d161d7de1a req-aa313518-bcee-4f2b-910b-2ca3743aed44 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:49.045808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-27e40ba7-2154-4711-850b-d2d161d7de1a req-aa313518-bcee-4f2b-910b-2ca3743aed44 service nova] Creating event network-vif-deleted:0f6f046c-2f1b-4f9e-92da-901ace4f7a8d for instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 on hv-cinder-83979 May 30 12:13:49.051785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-27e40ba7-2154-4711-850b-d2d161d7de1a req-aa313518-bcee-4f2b-910b-2ca3743aed44 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044937 May 30 12:13:49.052949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 511/983] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:49.479121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:49.479889 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:49.487066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:49.487648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:49.488588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:49.489028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:49.522456 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:49.522908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:49.523366 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lazy-loading 'fault' on Instance uuid 5bcbb825-7478-4165-a482-ea20ede5a5b2 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:13:49.566549 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e12d075bc9144a5e8de3fe53004e9052', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74054e993c3a4c8794bb96540281f87d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:13:49.580416 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d07ddea8-2f68-4728-8301-ea232405b0db tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 200 len: 1332 microversion: 2.1 time: 0.106573 May 30 12:13:49.581219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 473/984] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:49 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:13:50.598582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:50.599284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:50.607665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:50.608156 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:50.608934 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:50.609372 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:50.623366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 HTTP/1.1 May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:50.625034 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:50.627687 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '5bcbb825-7478-4165-a482-ea20ede5a5b2'} May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:50.629138 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:50.631570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:50.634222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:50.634222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ecb5110b-8557-4fdc-8ed8-02a604a20a2f tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 404 len: 111 microversion: 2.1 time: 0.033283 May 30 12:13:50.634222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 512/985] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:50 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:50.638042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-75c0b77e-4657-4e67-bb65-84b09813b4b0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '.version_select at 0x7f61a2637ee0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:50.655770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-75c0b77e-4657-4e67-bb65-84b09813b4b0 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190236288" status: 202 len: 0 microversion: 2.1 time: 0.023191 May 30 12:13:50.656385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 474/986] 10.222.0.41 () {58 vars in 1220 bytes} [Mon May 30 12:13:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1190236288 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:13:52.533599 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:52.534229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:52.546606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:52.546606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:52.546606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:52.546606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:52.557948 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 HTTP/1.1 May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:52.559570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.561173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '5bcbb825-7478-4165-a482-ea20ede5a5b2'} May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:52.561993 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.563417 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:52.565216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:52.565216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-eee0be2e-d329-4f45-849b-fe7c9f20da2b tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 404 len: 111 microversion: 2.1 time: 0.032463 May 30 12:13:52.565216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 513/987] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:52 2022] DELETE /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:52.570256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:52.572651 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5bcbb825-7478-4165-a482-ea20ede5a5b2] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:52.579178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:52.579635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:52.580718 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:52.581101 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:52.594511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 HTTP/1.1 May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:13:52.596709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.598255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '5bcbb825-7478-4165-a482-ea20ede5a5b2'} May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:52.599139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. May 30 12:13:52.600578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:52.602380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5bcbb825-7478-4165-a482-ea20ede5a5b2 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:52.602380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-043b8c9e-5051-4185-859a-3da41b974703 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2" status: 404 len: 111 microversion: 2.1 time: 0.032194 May 30 12:13:52.602380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 475/988] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:52 2022] GET /compute/v2.1/servers/5bcbb825-7478-4165-a482-ea20ede5a5b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:53.744144 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:53.744790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:53.751325 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.753065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.753889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.754510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.772600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a HTTP/1.1 May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:53.776564 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.778157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '330d9528-b5d4-4793-8273-6f08e7934f0a'} May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:53.779029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.780539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.781939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:53.781939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-295a23c3-eb6f-4195-976f-68e32cd5f4ae tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 404 len: 111 microversion: 2.1 time: 0.039835 May 30 12:13:53.781939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 514/989] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:53 2022] DELETE /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:53.790014 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:53.790667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 330d9528-b5d4-4793-8273-6f08e7934f0a] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:53.798273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.799367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.800275 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.800724 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.815992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a HTTP/1.1 May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:13:53.817593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.818880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '330d9528-b5d4-4793-8273-6f08e7934f0a'} May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:53.819643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. May 30 12:13:53.821017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.822304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 330d9528-b5d4-4793-8273-6f08e7934f0a could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:53.822304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2ff10938-d9f3-4ab2-8d09-d5a9e4ff5d27 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a" status: 404 len: 111 microversion: 2.1 time: 0.033115 May 30 12:13:53.822304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 476/990] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:53 2022] GET /compute/v2.1/servers/330d9528-b5d4-4793-8273-6f08e7934f0a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:53.827395 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:53.827925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:53.834592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.835043 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.835843 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.836275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.852126 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f HTTP/1.1 May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:53.853686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.855263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'ea5b29cb-133f-4082-a3f5-5094e70ccb3f'} May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:53.856194 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.857640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:53.859060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:53.859060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a20ddf9b-8efc-4030-ac34-378071b0a684 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.031501 May 30 12:13:53.859060 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 515/991] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:53 2022] DELETE /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:53.864349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:53.865003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: ea5b29cb-133f-4082-a3f5-5094e70ccb3f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:53.871337 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.871927 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.872733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:53.873173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:53.889613 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f HTTP/1.1 May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:13:53.891123 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.893285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'ea5b29cb-133f-4082-a3f5-5094e70ccb3f'} May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:53.894207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. May 30 12:13:53.895591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:53.896837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance ea5b29cb-133f-4082-a3f5-5094e70ccb3f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:53.896837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cddaf607-02cd-4894-a0b7-65d1b183ad7a tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f" status: 404 len: 111 microversion: 2.1 time: 0.032866 May 30 12:13:53.896837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 477/992] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:53 2022] GET /compute/v2.1/servers/ea5b29cb-133f-4082-a3f5-5094e70ccb3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:55.031806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:55.032466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:55.039506 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:55.040222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:55.041019 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:55.041459 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:55.056098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f HTTP/1.1 May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:13:55.057981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.059707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '5505ae9e-14bf-49a2-9e34-b42e866bb86f'} May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:55.060559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.061833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:13:55.063087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:55.063087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-99433566-ae87-4f45-bd9b-dd1fc84e6805 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 404 len: 111 microversion: 2.1 time: 0.031812 May 30 12:13:55.063087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 516/993] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:13:55 2022] DELETE /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:55.069708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:55.070291 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] [instance: 5505ae9e-14bf-49a2-9e34-b42e866bb86f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:55.077485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:55.077946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:55.078721 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:55.079163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:55.094023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] HTTP exception thrown: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Request method failure captured: May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f HTTP/1.1 May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNQY6l_UdzNACrdmRG2Tq0y3cuXjW4vW3sE3iAJ1nD1XvM-6BPMkepN0LJ7uau2SNi7kldOtnSIqmcNjQHkrIyUofQW2-N3W3U9_PofStlbKjprMDuuiHvKq4YodgA_jFxG-VTOly563VC9sXwP39wNRM6lmThXcyeEuGa6MVnIIJA May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:13:55.095754 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_74054e993c3a4c8794bb96540281f87d", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/74054e993c3a4c8794bb96540281f87d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 74054e993c3a4c8794bb96540281f87d May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1632286661 May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: e12d075bc9144a5e8de3fe53004e9052 May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeNegativeTest-1632286661-project May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.097267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '5505ae9e-14bf-49a2-9e34-b42e866bb86f'} May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:13:55.097992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. May 30 12:13:55.100017 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:13:55.101991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] Returning 404 to user: Instance 5505ae9e-14bf-49a2-9e34-b42e866bb86f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:13:55.101991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-750fadbd-98c4-4e00-8757-9840f8446853 tempest-AttachVolumeNegativeTest-1632286661 tempest-AttachVolumeNegativeTest-1632286661-project] 10.222.0.41 "GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f" status: 404 len: 111 microversion: 2.1 time: 0.033225 May 30 12:13:55.101991 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 478/994] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:13:55 2022] GET /compute/v2.1/servers/5505ae9e-14bf-49a2-9e34-b42e866bb86f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:13:56.287607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:56.288565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:56.295045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:56.295497 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:56.296309 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:56.296753 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:56.326909 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4d57380e-3079-4638-9ca7-5e5b7d6dafe0 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 May 30 12:13:56.327468 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 517/995] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:13:56 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:56.337410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:13:56.337956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:56.344587 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:56.345038 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:56.346344 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:56.346779 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:56.377544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1e8d7356-2ab7-4b07-91d3-a1419be37ce5 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4" status: 200 len: 194 microversion: 2.1 time: 0.043882 May 30 12:13:56.378234 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 479/996] 10.222.0.41 () {58 vars in 1412 bytes} [Mon May 30 12:13:56 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:13:58.788805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26e3cf7d-dc80-49f4-8e5e-4ddb1cdc6faf"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:13:58.789860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:13:58.796327 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:58.796775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:58.797537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:13:58.797966 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:13:59.086658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-46f1d3d1-298f-42e7-8d93-af6dec406033 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "POST /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301632 May 30 12:13:59.087385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 518/997] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:13:58 2022] POST /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:06.638009 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:06.639109 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:06.641734 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:06.642559 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:06.649448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.649907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.650694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.651139 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.682596 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c28c3d2a-b0cc-40bb-a5ca-2738b5cb5685 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048570 May 30 12:14:06.683191 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 480/998] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:14:06 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:06.824218 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:06.824897 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:06.826912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:06.834294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.834832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.835684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.836160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.867174 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f33d5d5a-b3cc-444d-9f7a-46134fed0d9e tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4" status: 200 len: 194 microversion: 2.1 time: 0.047792 May 30 12:14:06.867805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 519/999] 10.222.0.41 () {58 vars in 1412 bytes} [Mon May 30 12:14:06 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:06.878020 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:06.878525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:06.884801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.885273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.886054 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:06.886495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:06.977808 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lazy-loading 'services' on Instance uuid 60235790-c023-4db4-947f-56e28cb40e1f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:14:07.220084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e1edaa41-2de5-4075-bddd-b9af986112bd tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4" status: 202 len: 0 microversion: 2.1 time: 0.346325 May 30 12:14:07.221060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 481/1000] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:14:06 2022] DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/ada5cd74-9926-4407-88be-79cf455d8cf4 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:14:09.409606 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:09.410895 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:09.418314 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.418766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.419913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.421027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.456865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9ed851ce-fbd2-4021-a52b-86a530b86409 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/26e3cf7d-dc80-49f4-8e5e-4ddb1cdc6faf" status: 200 len: 194 microversion: 2.1 time: 0.051759 May 30 12:14:09.461913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 520/1001] 10.222.0.41 () {58 vars in 1412 bytes} [Mon May 30 12:14:09 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/26e3cf7d-dc80-49f4-8e5e-4ddb1cdc6faf => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:09.468913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:09.469508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:09.477824 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.478532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.479315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:09.479954 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:09.586292 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lazy-loading 'services' on Instance uuid 60235790-c023-4db4-947f-56e28cb40e1f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:14:09.683278 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-67685e32-4c90-4438-a18d-31b9d9f801a6 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/26e3cf7d-dc80-49f4-8e5e-4ddb1cdc6faf" status: 202 len: 0 microversion: 2.1 time: 0.219593 May 30 12:14:09.684232 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 482/1002] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:14:09 2022] DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments/26e3cf7d-dc80-49f4-8e5e-4ddb1cdc6faf => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:14:10.878090 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:10.879055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:10.885528 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:10.885924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:10.886700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:10.887140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:10.915913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-af1bb21d-e234-4ef0-a670-1fc8f164c8d2 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042596 May 30 12:14:10.916478 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 521/1003] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:14:10 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:14:11.052419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:11.053826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:11.060643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.061097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.062042 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.062479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.095244 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-97ab7735-2417-4808-a0b2-0d4ad574b806 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048137 May 30 12:14:11.095846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 483/1004] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:14:11 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:14:11.164796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:11.165649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:11.172512 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.173139 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.174487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.174932 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.206111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:14:11.292165 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2e7e19ee-fabd-42c4-9ffa-410b99db9b2c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 204 len: 0 microversion: 2.1 time: 0.132109 May 30 12:14:11.292721 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 522/1005] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:14:11 2022] DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:14:11.308488 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:11.309155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:11.316860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.317316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.318098 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:11.318534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:11.467497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:11.477183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-a661eb73-a3d2-4162-b8b8-815eb6fba6a9 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1673 microversion: 2.1 time: 0.179366 May 30 12:14:11.477814 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 484/1006] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:11 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:12.496488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:12.497848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:12.504805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:12.505712 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:12.506696 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:12.507358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:12.780122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:12.783317 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:12.790242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-fb00125e-4002-4c6e-9ed9-7fb184f31144 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1673 microversion: 2.1 time: 0.298136 May 30 12:14:12.791147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 523/1007] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:12 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1673 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:13.811339 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:13.812629 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:13.821919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:13.822454 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:13.823272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:13.823704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:14.195602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:14.208495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-60d2929c-e5a1-4c41-9b70-afbfb60ac28c tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1673 microversion: 2.1 time: 0.402905 May 30 12:14:14.219404 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 485/1008] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:13 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1673 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:14.869083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-02ba650b-62c0-4af3-9522-29a0da189667 req-87a31a3f-3cb3-499b-926a-df826684d934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60235790-c023-4db4-947f-56e28cb40e1f", "name": "network-vif-deleted", "tag": "bef31487-4449-4d57-923c-451900a21460"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:14.883931 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-02ba650b-62c0-4af3-9522-29a0da189667 req-87a31a3f-3cb3-499b-926a-df826684d934 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:14.884362 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-02ba650b-62c0-4af3-9522-29a0da189667 req-87a31a3f-3cb3-499b-926a-df826684d934 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:14.902410 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-02ba650b-62c0-4af3-9522-29a0da189667 req-87a31a3f-3cb3-499b-926a-df826684d934 service nova] Creating event network-vif-deleted:bef31487-4449-4d57-923c-451900a21460 for instance 60235790-c023-4db4-947f-56e28cb40e1f on hv-cinder-83979 May 30 12:14:14.917669 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-02ba650b-62c0-4af3-9522-29a0da189667 req-87a31a3f-3cb3-499b-926a-df826684d934 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052939 May 30 12:14:14.922894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 524/1009] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:15.227572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:15.228785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:15.237773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:15.238543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:15.239331 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:15.240789 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:15.303322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:15.304097 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:15.304913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lazy-loading 'fault' on Instance uuid 60235790-c023-4db4-947f-56e28cb40e1f {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:14:15.375052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ee1e385f10e4ed4849ef2febc22e497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63d6c4272b654ba18d854527b14b1a88', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:15.389477 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b33c8823-726e-4846-b3a9-68f8fe138b16 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 200 len: 1327 microversion: 2.1 time: 0.167266 May 30 12:14:15.390764 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 486/1010] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:15 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 1327 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:16.410229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:16.411561 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:16.420925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:16.422150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:16.423784 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:16.424522 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:16.445480 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f HTTP/1.1 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:16.448151 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:16.449852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '60235790-c023-4db4-947f-56e28cb40e1f'} May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:16.450900 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:16.452513 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:16.455930 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:16.457580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a2fad06c-52d6-4858-a2f8-1f9b45bb6906 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 404 len: 111 microversion: 2.1 time: 0.053422 May 30 12:14:16.461710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 525/1011] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:16 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:14:16.467643 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4a49dd2e-3926-4b54-b9ad-af57d27c5c89 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '.version_select at 0x7f61a2580940>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:16.493616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4a49dd2e-3926-4b54-b9ad-af57d27c5c89 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132768665" status: 202 len: 0 microversion: 2.1 time: 0.030518 May 30 12:14:16.497492 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 487/1012] 10.222.0.41 () {58 vars in 1220 bytes} [Mon May 30 12:14:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132768665 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:14:19.836946 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:19.838004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:19.855209 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.855675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.858902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.859401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.914717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f HTTP/1.1 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:19.924595 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:19.925901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '60235790-c023-4db4-947f-56e28cb40e1f'} May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:19.926710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:19.928636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:19.942559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:19.942559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-462e5e5d-4e04-467f-b511-14eeb8bf96f8 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 404 len: 111 microversion: 2.1 time: 0.093223 May 30 12:14:19.942559 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 526/1013] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:14:19 2022] DELETE /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:14:19.951827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:19.953069 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 60235790-c023-4db4-947f-56e28cb40e1f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:19.968853 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.969485 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:19.979766 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:19.980357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:20.014338 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f HTTP/1.1 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:14:20.016496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:20.018219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '60235790-c023-4db4-947f-56e28cb40e1f'} May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:20.019110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. May 30 12:14:20.020582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:20.024005 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 60235790-c023-4db4-947f-56e28cb40e1f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:20.024907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-711c5986-223b-4fcc-a32b-e0c5450fab04 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f" status: 404 len: 111 microversion: 2.1 time: 0.077688 May 30 12:14:20.025486 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 488/1014] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:19 2022] GET /compute/v2.1/servers/60235790-c023-4db4-947f-56e28cb40e1f => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:14:21.209904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:21.211017 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:21.222424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:21.224356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:21.226674 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:21.228683 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:21.259890 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db HTTP/1.1 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:21.261472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.263059 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '74de07ed-a2fe-45f8-ac09-ec21741046db'} May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:21.263962 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.265501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:21.267619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:21.267619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6a68a383-f225-44da-ab84-20ff7ebdda20 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 404 len: 111 microversion: 2.1 time: 0.057045 May 30 12:14:21.272297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:21.272829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] [instance: 74de07ed-a2fe-45f8-ac09-ec21741046db] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:21.287632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:21.288156 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:21.288951 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:21.289390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:21.289982 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 527/1015] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:14:21 2022] DELETE /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 30 12:14:21.318816 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] HTTP exception thrown: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Request method failure captured: May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db HTTP/1.1 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNZ8pzC9U_5K7QTwl0iEkhnvv0uCVMzvjC4HLZl3AqZdsOw8rPPH6Ls8HZdy6i6zJZ21Gj3TpK15tKthTjjJa2wamknJp93lkn3ahpynQootGRvCkVYo32JDaH6uN546L7K2Erlwd1G4S6NslFDCfMBa_RAbyFbJTtZ8p9zsb1QUPY May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:14:21.320914 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_63d6c4272b654ba18d854527b14b1a88", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/63d6c4272b654ba18d854527b14b1a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 63d6c4272b654ba18d854527b14b1a88 May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1242293032 May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 5ee1e385f10e4ed4849ef2febc22e497 May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeTestJSON-1242293032-project May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.322441 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '74de07ed-a2fe-45f8-ac09-ec21741046db'} May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:21.323286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. May 30 12:14:21.324843 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:21.331544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] Returning 404 to user: Instance 74de07ed-a2fe-45f8-ac09-ec21741046db could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:21.332550 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da5f56cd-d932-4bd4-8e2a-5a626b314140 tempest-AttachVolumeTestJSON-1242293032 tempest-AttachVolumeTestJSON-1242293032-project] 10.222.0.41 "GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db" status: 404 len: 111 microversion: 2.1 time: 0.064212 May 30 12:14:21.340003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 489/1016] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:21 2022] GET /compute/v2.1/servers/74de07ed-a2fe-45f8-ac09-ec21741046db => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:14:25.955255 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:25.959767 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:25.974684 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:25.992618 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:25.994230 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:25.994675 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:26.042603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3c4bf3ce-333e-458f-95a0-b3e2b3406434 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.093015 May 30 12:14:26.048829 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 528/1017] 10.222.0.41 () {60 vars in 1342 bytes} [Mon May 30 12:14:25 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:26.153729 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:26.156203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:26.184419 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:26.187541 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:26.189163 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:26.189849 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:26.258016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:14:26.451787 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-98315aad-1d5d-4b1e-a040-2c9e7d98344f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 204 len: 0 microversion: 2.20 time: 0.303925 May 30 12:14:26.452600 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 490/1018] 10.222.0.41 () {60 vars in 1279 bytes} [Mon May 30 12:14:26 2022] DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:14:26.462381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:26.462983 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:26.475009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:26.475449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:26.476542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:26.477136 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:26.811530 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:26.830168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:26.831848 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:26.833011 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-59a8211f-a71d-4c15-a1e5-f696f227aecc tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.374583 May 30 12:14:26.833565 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 529/1019] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:26 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:14:27.854479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:27.855760 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:27.865385 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:27.866039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:27.867045 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:27.867665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:28.166482 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:28.177774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:28.179285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:28.181767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-54808ab8-d0d5-4ff4-ae5f-edb9607ffb16 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.334111 May 30 12:14:28.186896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 491/1020] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:27 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:14:29.208340 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:29.210000 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:29.222420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:29.225714 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:29.227572 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:29.229283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:29.528961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:29.530243 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-339b3b96-85cd-4cdd-8270-59429a783f35 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Action: 'create', calling method: .version_select at 0x7f61a251de50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1581943473", "metadata": {"Type": "work"}}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:29.543510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:29.549082 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:29.550727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4ca1ea90-e4b8-4db1-ad87-8b7a204b5f93 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1725 microversion: 2.20 time: 0.347623 May 30 12:14:29.551199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 530/1021] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:29 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:14:30.105637 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-732b1d6c-c393-40b2-8b3c-349c31720139 req-e91f662c-1d1f-4de9-9580-9dc3f4c70778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9290dd18-9781-4201-9574-355d6078a3b0", "name": "network-vif-deleted", "tag": "3af08668-495c-45e5-9a4f-8721904aa9c8"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:30.116940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-732b1d6c-c393-40b2-8b3c-349c31720139 req-e91f662c-1d1f-4de9-9580-9dc3f4c70778 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:30.118092 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-732b1d6c-c393-40b2-8b3c-349c31720139 req-e91f662c-1d1f-4de9-9580-9dc3f4c70778 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:30.133449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-732b1d6c-c393-40b2-8b3c-349c31720139 req-e91f662c-1d1f-4de9-9580-9dc3f4c70778 service nova] Creating event network-vif-deleted:3af08668-495c-45e5-9a4f-8721904aa9c8 for instance 9290dd18-9781-4201-9574-355d6078a3b0 on hv-cinder-83979 May 30 12:14:30.155184 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-732b1d6c-c393-40b2-8b3c-349c31720139 req-e91f662c-1d1f-4de9-9580-9dc3f4c70778 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057375 May 30 12:14:30.178439 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 531/1022] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:14:30.259864 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-339b3b96-85cd-4cdd-8270-59429a783f35 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.013030 May 30 12:14:30.260674 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 492/1023] 10.222.0.41 () {60 vars in 1155 bytes} [Mon May 30 12:14:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1015 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 30 12:14:30.282509 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-15ee1746-6840-4929-9671-f58ad7fbc277 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a1bc0160>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:30.360541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-15ee1746-6840-4929-9671-f58ad7fbc277 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 200 len: 353 microversion: 2.1 time: 0.085543 May 30 12:14:30.367314 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 532/1024] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:14:30 2022] GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:30.570804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:30.571491 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:30.589997 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:30.590496 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:30.595476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:30.597532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:30.701327 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:30.701788 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:30.702254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lazy-loading 'fault' on Instance uuid 9290dd18-9781-4201-9574-355d6078a3b0 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:14:30.813767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:30.828285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:30.839397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c9292fdef7f41af8fcb9375ce1764e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185231fbe57e438a9ee70b39991235b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:30.845947 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c0d1a363-c825-4544-b213-1f277abf70fd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 200 len: 1371 microversion: 2.20 time: 0.279378 May 30 12:14:30.855260 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 493/1025] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:30 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 1371 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 30 12:14:31.379472 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4dcb3133-4ca9-4a31-a77f-94cb1b0ac5bf tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a1c9c8b0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:31.494471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4dcb3133-4ca9-4a31-a77f-94cb1b0ac5bf tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 200 len: 354 microversion: 2.1 time: 0.122998 May 30 12:14:31.494471 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 533/1026] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:14:31 2022] GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:31.508376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ac423181-1662-469a-8fda-ce9114233a76 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a251daf0>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:31.619268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ac423181-1662-469a-8fda-ce9114233a76 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 200 len: 354 microversion: 2.1 time: 0.114560 May 30 12:14:31.634742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 494/1027] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:14:31 2022] GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:31.641939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d892b99d-c82a-44c4-9908-2ab1c4f87971 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a1c9c3a0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:31.821084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d892b99d-c82a-44c4-9908-2ab1c4f87971 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 202 len: 0 microversion: 2.1 time: 0.187218 May 30 12:14:31.824182 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 534/1028] 10.222.0.41 () {58 vars in 1247 bytes} [Mon May 30 12:14:31 2022] DELETE /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:14:31.851756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6ac4a73d-4264-4b32-81f8-09f676fe1994 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a39c7430>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:31.883470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:31.889975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:31.919065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:31.923862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:31.927283 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:31.929257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:31.971396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 HTTP/1.1 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:31.973442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:31.974905 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '9290dd18-9781-4201-9574-355d6078a3b0'} May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:31.975627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:31.977170 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:31.979408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:31.980561 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-160f6189-fc0b-413a-9876-b7d7f9624c92 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 404 len: 111 microversion: 2.20 time: 0.111710 May 30 12:14:31.981615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 535/1029] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:31 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:14:31.991477 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b251024d-f9b4-4d1d-96da-e0c7e5e42673 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '.version_select at 0x7f61a1cb11f0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:32.014586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6ac4a73d-4264-4b32-81f8-09f676fe1994 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 200 len: 353 microversion: 2.1 time: 0.170235 May 30 12:14:32.015542 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 495/1030] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:14:31 2022] GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 353 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:32.029972 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b251024d-f9b4-4d1d-96da-e0c7e5e42673 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790771032" status: 204 len: 0 microversion: 2.20 time: 0.043337 May 30 12:14:32.052036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 536/1031] 10.222.0.41 () {60 vars in 1261 bytes} [Mon May 30 12:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790771032 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 30 12:14:33.029245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d6efb3ec-f15d-4d6d-894d-5c10d8ab89e2 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Calling method '.version_select at 0x7f61a267c430>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:33.095368 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-d6efb3ec-f15d-4d6d-894d-5c10d8ab89e2 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] HTTP exception thrown: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d6efb3ec-f15d-4d6d-894d-5c10d8ab89e2 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Request method failure captured: May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 HTTP/1.1 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLUlmTWzwlVEVTnKC3X02hUzflV6qQz-O_eXJLoDcACL7V5UlrMsSf9IAT7Ct0PGWZMS5IXw2UNZ75qAieCx7QmV-kzlA7rKvpwikozCRkDskWogj5VDXHsVVZg7d9BF8Kvd67qOIMk6ImwCfkoRdNOVw1_Wzwsu-l9_uEwauCLu9Q4 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: c13d53c508704087b72fe29e7e4000de May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-VolumesGetTestJSON-1529494299 May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:14:33.097502 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/c13d53c508704087b72fe29e7e4000de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_c13d53c508704087b72fe29e7e4000de", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c13d53c508704087b72fe29e7e4000de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/c13d53c508704087b72fe29e7e4000de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-VolumesGetTestJSON-1529494299 May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: c13d53c508704087b72fe29e7e4000de May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-VolumesGetTestJSON-1529494299 May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-VolumesGetTestJSON-1529494299-project May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: bfcae08b804b4250ad00ccc88fba3812 May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-VolumesGetTestJSON-1529494299-project May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'cca458fc-8835-496e-9052-982e3621cc25'} May 30 12:14:33.099073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. (HTTP 404) (Request-ID: req-203b2bd8-db95-4e7d-923c-bce00dc74135) May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:33.100332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi item = cinderclient( May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 30 12:14:33.101777 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 30 12:14:33.102930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d6efb3ec-f15d-4d6d-894d-5c10d8ab89e2 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] Returning 404 to user: Volume cca458fc-8835-496e-9052-982e3621cc25 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d6efb3ec-f15d-4d6d-894d-5c10d8ab89e2 tempest-VolumesGetTestJSON-1529494299 tempest-VolumesGetTestJSON-1529494299-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25" status: 404 len: 109 microversion: 2.1 time: 0.074254 May 30 12:14:33.104200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 496/1032] 10.222.0.41 () {58 vars in 1244 bytes} [Mon May 30 12:14:33 2022] GET /compute/v2.1/os-volumes/cca458fc-8835-496e-9052-982e3621cc25 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:14:34.281504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:34.282452 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:34.289401 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:34.289846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:34.290607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:34.291036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:34.309101 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 HTTP/1.1 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:34.310756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.312267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '9290dd18-9781-4201-9574-355d6078a3b0'} May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:34.314247 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.316335 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:34.319137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:34.319137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b39f1188-73c8-47dd-9f0f-b9c7256d9ce7 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 404 len: 111 microversion: 2.20 time: 0.035323 May 30 12:14:34.319137 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 537/1033] 10.222.0.41 () {60 vars in 1279 bytes} [Mon May 30 12:14:34 2022] DELETE /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:14:34.327838 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:34.329283 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: 9290dd18-9781-4201-9574-355d6078a3b0] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:34.337367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:34.337911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:34.339012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:34.339547 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:34.358550 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 HTTP/1.1 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:14:34.361634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.363052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '9290dd18-9781-4201-9574-355d6078a3b0'} May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:34.363806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. May 30 12:14:34.365060 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:34.368198 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance 9290dd18-9781-4201-9574-355d6078a3b0 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:34.369349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e4c24df7-4d83-464a-8600-7bbb1a782ff9 tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0" status: 404 len: 111 microversion: 2.20 time: 0.048315 May 30 12:14:34.370135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 497/1034] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:34 2022] GET /compute/v2.1/servers/9290dd18-9781-4201-9574-355d6078a3b0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:14:35.571466 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:35.572018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:35.579805 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:35.580358 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:35.581275 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:35.582105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:35.601532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 HTTP/1.1 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:14:35.603389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.604856 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': 'c9cdf2a8-edd4-4a18-8fa9-443148005b88'} May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:35.605633 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.606811 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:14:35.611761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:35.611761 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cab1702f-56ca-41d4-a5f0-dac13927eccd tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 404 len: 111 microversion: 2.20 time: 0.038815 May 30 12:14:35.614474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:35.615094 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] [instance: c9cdf2a8-edd4-4a18-8fa9-443148005b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:35.620210 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 538/1035] 10.222.0.41 () {60 vars in 1279 bytes} [Mon May 30 12:14:35 2022] DELETE /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:14:35.622369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:35.622827 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:35.623672 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:35.624171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] HTTP exception thrown: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Request method failure captured: May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 HTTP/1.1 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLNYpI15-YQaKYw4Yktve54L-tpDy3LGz-1EMKyIe-YfQr_iz5XYr0-XxbUnNPX7-2TDxM15Dg41EyLz2tDQ7gOJC_hRJVpmzo8qPcFIsVwyDn3cr25zh8q_b3-OAXXUKMF11re1rnCaPDh9nbXHoEVARq-WI2caTw6n4P6tQMhW7vo May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Openstack-Nova-Api-Version: 2.20 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:14:35.644498 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_185231fbe57e438a9ee70b39991235b2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/185231fbe57e438a9ee70b39991235b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 185231fbe57e438a9ee70b39991235b2 May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1887657836 May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 9c9292fdef7f41af8fcb9375ce1764e2 May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1887657836-project May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.645880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': 'c9cdf2a8-edd4-4a18-8fa9-443148005b88'} May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:14:35.646588 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. May 30 12:14:35.647751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:14:35.650028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] Returning 404 to user: Instance c9cdf2a8-edd4-4a18-8fa9-443148005b88 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:14:35.650028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-325dbaca-64f2-48ad-9fda-75a9eefaec1f tempest-AttachVolumeShelveTestJSON-1887657836 tempest-AttachVolumeShelveTestJSON-1887657836-project] 10.222.0.41 "GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88" status: 404 len: 111 microversion: 2.20 time: 0.034104 May 30 12:14:35.650028 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 498/1036] 10.222.0.41 () {60 vars in 1276 bytes} [Mon May 30 12:14:35 2022] GET /compute/v2.1/servers/c9cdf2a8-edd4-4a18-8fa9-443148005b88 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 30 12:14:39.034760 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9b804e00-b13b-4fa6-a573-454c4dd77aaf tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'create', calling method: .version_select at 0x7f61a1a319d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-772321380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE++TD1FCDVg1LqjBpm1L7lk6/LFZZYNQiSscp4v0uZ4TkULXtwuq65G3aMgR8V3+4pqRaTUHCm8j7XCig6SOT1VlkL5W9Uww5p5trLb/VTS1Ew/sT/h+nY+gqR+oGZdTQ=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:39.041338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:39.058220 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-9b804e00-b13b-4fa6-a573-454c4dd77aaf tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Getting quotas for project cd1f7d3f6294439090a64d1b442e0789. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:14:39.072409 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-9b804e00-b13b-4fa6-a573-454c4dd77aaf tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Getting quotas for user 91cb81b73de1405899bfa73cecb8e1ae and project cd1f7d3f6294439090a64d1b442e0789. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:14:39.107586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9b804e00-b13b-4fa6-a573-454c4dd77aaf tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.077321 May 30 12:14:39.108267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 539/1037] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:14:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:39.247177 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-886199808", "imageRef": "6b358564-9cf0-4da9-8ffc-c3c781bf64ab", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-772321380", "networks": [{"uuid": "ac6a9663-53ef-4e93-9d2f-fd78ef029542"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:39.260175 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:39.320276 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] validate_networks() for [('ac6a9663-53ef-4e93-9d2f-fd78ef029542', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:14:39.950457 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:14:39.950885 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:14:39.951640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:14:39.952090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:14:39.952504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:14:39.964282 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:39.964764 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:39.965465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:39.967586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:39.980309 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:39.992092 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Getting quotas for project cd1f7d3f6294439090a64d1b442e0789. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:14:39.997121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Getting quotas for user 91cb81b73de1405899bfa73cecb8e1ae and project cd1f7d3f6294439090a64d1b442e0789. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:14:40.010911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:14:40.013190 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6b358564-9cf0-4da9-8ffc-c3c781bf64ab',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:14:40.077179 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e00611cc-c8f9-4810-aee7-479f4522abf4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.842079 May 30 12:14:40.085850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 499/1038] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:14:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:14:40.101956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4c57b664-c830-48d1-bc2b-ab84eff9be90 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:40.103803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4c57b664-c830-48d1-bc2b-ab84eff9be90 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:40.205488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4c57b664-c830-48d1-bc2b-ab84eff9be90 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:40.213642 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4c57b664-c830-48d1-bc2b-ab84eff9be90 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1257 microversion: 2.1 time: 0.128514 May 30 12:14:40.214730 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 540/1039] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:40 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1257 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:41.232933 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:41.234376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:41.242531 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:41.243268 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:41.244420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:41.245162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:41.349023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:41.357497 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-2dfdfa15-6d77-4e02-8f54-45f249d6f1f5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1261 microversion: 2.1 time: 0.129362 May 30 12:14:41.367170 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 500/1040] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:41 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1261 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:42.374338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:42.374965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:42.383941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:42.384475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:42.385177 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:42.386030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:42.465118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:42.472758 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f0e5f145-8f9f-4595-8abd-f1386334662f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1253 microversion: 2.1 time: 0.101949 May 30 12:14:42.473941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 541/1041] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:42 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1253 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:43.489826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:43.490452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:43.502871 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:43.503325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:43.504135 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:43.504582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:43.728762 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:43.738850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-909d918b-1403-4d2c-abbb-9f4780160366 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1315 microversion: 2.1 time: 0.252712 May 30 12:14:43.747577 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 501/1042] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:43 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:44.756429 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:44.757827 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:44.764578 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:44.765280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:44.767261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:44.768112 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:44.940087 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:44.947686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-444272d8-4a75-4964-b57d-86df73c2f357 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.195292 May 30 12:14:44.948213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 542/1043] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:44 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:45.965911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:45.965911 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:45.987868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:45.988348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:45.989164 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:45.989605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:46.122357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:46.130979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-41b2d481-231a-490a-9289-649f90e067ad tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.170349 May 30 12:14:46.131653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 502/1044] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:45 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:47.151458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:47.152268 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:47.161199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:47.161658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:47.162445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:47.164625 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:47.168212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=48 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:47.620107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:47.629756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-baf6c1f0-27a9-416f-a758-e3dd6852df06 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.483763 May 30 12:14:47.631029 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 543/1045] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:47 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:48.651390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:48.652717 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:48.669976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:48.671723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:48.673782 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:48.677184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:48.864415 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:48.879957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c58ebd04-7cf0-4c83-8d9c-2dfcde240bca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.235339 May 30 12:14:48.881508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 503/1046] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:48 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:49.897707 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:49.898950 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:49.906094 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:49.907371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:49.908264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:49.908863 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:50.086147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:50.094455 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3a9ea87e-089b-4b88-8855-87080c2f9ac7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.200510 May 30 12:14:50.104912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 544/1047] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:49 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:51.121131 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:51.121743 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:51.128753 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:51.129683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:51.131522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:51.132176 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:51.133154 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:51.133593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:51.321635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:51.339045 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bfa58c1c-b911-4b43-82af-96a2754f4f5b tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.221672 May 30 12:14:51.341225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 504/1048] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:51 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:52.368105 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:52.369336 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:52.372274 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=6 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:14:52.380257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:52.380715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:52.382143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:52.382581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:52.585613 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:52.595189 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b0461a6f-4025-43ed-9ae9-132bba03356a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.231233 May 30 12:14:52.605481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 545/1049] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:52 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:14:53.612409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:53.612966 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:53.619467 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:53.619966 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:53.620742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:53.621185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:53.765446 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:53.773536 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1a0a135d-b5b1-49a6-8f77-897e803657eb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.165591 May 30 12:14:53.774116 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 505/1050] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:53 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:54.790341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:54.790964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:54.797701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:54.798216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:54.798963 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:54.799431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:54.930045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:54.938649 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0009a7f7-3d97-4f93-9bd5-aadfa7c42509 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.151140 May 30 12:14:54.939229 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 546/1051] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:54 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:55.955073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:55.955761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:55.962440 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:55.963032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:55.963863 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:55.964307 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:56.224829 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:56.232869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8b1e861c-b67a-4853-8776-83b1bae54f54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.282099 May 30 12:14:56.233921 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 506/1052] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:55 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:56.604051 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-b4ee7c08-69bf-4097-bbbd-1230adb5a6db req-12e7f28c-d09f-4761-b13a-d0e76f1cf9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:14:56.617735 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b4ee7c08-69bf-4097-bbbd-1230adb5a6db req-12e7f28c-d09f-4761-b13a-d0e76f1cf9ee service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:56.618296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b4ee7c08-69bf-4097-bbbd-1230adb5a6db req-12e7f28c-d09f-4761-b13a-d0e76f1cf9ee service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:56.631103 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-b4ee7c08-69bf-4097-bbbd-1230adb5a6db req-12e7f28c-d09f-4761-b13a-d0e76f1cf9ee service nova] Creating event network-changed:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:14:56.636150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-b4ee7c08-69bf-4097-bbbd-1230adb5a6db req-12e7f28c-d09f-4761-b13a-d0e76f1cf9ee service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036462 May 30 12:14:56.636756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 547/1053] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:14:57.250981 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:57.251742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:57.260035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:57.260035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:57.260714 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:57.261463 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:57.448048 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:57.454976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-22e61343-f603-4362-bf72-0d0aeb972e52 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.208506 May 30 12:14:57.455571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 507/1054] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:57 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:58.473422 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:58.474111 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:58.480619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:58.481061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:58.481815 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:58.482282 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:58.647597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:58.659865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-afdd40d0-4ca9-4b1a-9fa2-9ae34c5bf5e9 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.191217 May 30 12:14:58.672546 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 548/1055] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:58 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:14:59.677336 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:14:59.677948 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:14:59.684534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:59.684994 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:59.685767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:14:59.686210 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:14:59.872121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:14:59.898227 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-28b1982b-7785-42a2-8dd9-1b4d25a2fee5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.224658 May 30 12:14:59.899134 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 508/1056] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:14:59 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:00.914486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:00.915286 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:00.922911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:00.923588 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:00.924398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:00.924832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:01.083646 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:01.101434 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a06083cb-bbac-459d-9c83-2b4ef270ef9a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.190607 May 30 12:15:01.102261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 549/1057] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:00 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:02.118274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:02.118882 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:02.127066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:02.127174 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:02.127939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:02.128374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:02.285635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:02.293153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d24bd579-8de2-49b6-bae1-06105ecd9b10 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.178653 May 30 12:15:02.294316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 509/1058] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:02 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:03.116289 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-d0bf6822-bc0a-46ea-834c-fa79eb610ce0 req-44d290cc-1a09-4046-a122-9c0235f34246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "name": "network-vif-plugged", "status": "completed", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:03.135119 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-d0bf6822-bc0a-46ea-834c-fa79eb610ce0 req-44d290cc-1a09-4046-a122-9c0235f34246 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:03.135862 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-d0bf6822-bc0a-46ea-834c-fa79eb610ce0 req-44d290cc-1a09-4046-a122-9c0235f34246 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:03.150399 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-d0bf6822-bc0a-46ea-834c-fa79eb610ce0 req-44d290cc-1a09-4046-a122-9c0235f34246 service nova] Creating event network-vif-plugged:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:15:03.159048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-d0bf6822-bc0a-46ea-834c-fa79eb610ce0 req-44d290cc-1a09-4046-a122-9c0235f34246 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050462 May 30 12:15:03.160301 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 550/1059] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:03.313544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:03.315206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:03.322765 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:03.323691 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:03.324524 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:03.325134 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:03.544465 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:03.552789 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-dd2cff06-8ce2-4367-a814-fd18d493a289 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1357 microversion: 2.1 time: 0.245765 May 30 12:15:03.553365 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 510/1060] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:03 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:04.570616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:04.571381 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:04.578514 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.579252 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:04.580222 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.580666 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:04.784533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:04.792166 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d6928bb8-adfa-475d-a05b-6d1bdc2f6938 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1548 microversion: 2.1 time: 0.226017 May 30 12:15:04.793980 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 551/1061] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:04 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:04.810551 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:04.811167 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:04.818429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.818878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:04.819648 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.820126 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:04.960976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:04.969783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-27452ed6-e0a6-4592-b1fc-fcf639d9a182 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1548 microversion: 2.1 time: 0.162985 May 30 12:15:04.972187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 511/1062] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:04 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:04.986206 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:04.989851 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:04.990620 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Searching by: {'deleted': False, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789'} {{(pid=117705) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 30 12:15:04.997349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.998109 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:04.998611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:04.999073 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:05.089672 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.multi_cell_list [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117705) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 30 12:15:05.188665 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f80ab95d-45cb-470f-8998-6038d8f84037 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206750 May 30 12:15:05.189250 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 552/1063] 10.222.0.41 () {58 vars in 1124 bytes} [Mon May 30 12:15:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:05.199238 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:05.199882 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:05.206023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:05.206480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:05.207565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:05.208036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:05.367682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:05.381425 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-becc110f-b374-410e-857a-85440f63a450 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1548 microversion: 2.1 time: 0.184573 May 30 12:15:05.382992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 512/1064] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:05 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1548 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:15.519852 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23d1a79f-2933-4317-bd28-81394fa3f8c3"}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:15.520925 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:15.523461 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:15.524145 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:15.524781 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=53 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:15.531140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:15.532431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:15.533201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:15.533639 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:18.088470 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-097ec5b3-8ad0-4f1a-b588-cae531805e82 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.573139 May 30 12:15:18.089153 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 553/1065] 10.222.0.41 () {60 vars in 1322 bytes} [Mon May 30 12:15:15 2022] POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 194 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:21.969034 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-980336072", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261961072", "security_groups": [{"name": "tempest-secgroup-smoke-784746195"}], "block_device_mapping_v2": [{"uuid": "c248a1c0-f06a-4497-b42e-9bab7f799a36", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc16439-b142-4833-aa53-bbb0e6914ce9"}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:21.978090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:21.979124 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=79 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:22.111008 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] validate_networks() for [('acc16439-b142-4833-aa53-bbb0e6914ce9', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:15:22.588656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:15:22.589292 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:15:22.589799 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:15:22.590405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:15:22.590913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:15:22.603032 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:22.603401 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:22.604246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:22.604690 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:22.624846 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:15:22.629147 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Getting quotas for user f7e7ce32b4c0457196c8765d6c5ada7e and project 4249e846c5d54876a6ed97678450c1d2. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:15:22.691586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:15:22.693683 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c248a1c0-f06a-4497-b42e-9bab7f799a36',volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:15:22.840137 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-471c9e3a-cc3a-4e51-9c9f-ebf5add212ff tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.875134 May 30 12:15:22.840795 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 513/1066] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:15:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:15:22.852369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c05c040e-7c12-4c04-bcc9-25b124db25af tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:22.853133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c05c040e-7c12-4c04-bcc9-25b124db25af tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:22.910630 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c05c040e-7c12-4c04-bcc9-25b124db25af tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:22.917436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c05c040e-7c12-4c04-bcc9-25b124db25af tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1093 microversion: 2.1 time: 0.069393 May 30 12:15:22.917887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 554/1067] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:22 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:23.935328 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:23.936225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:23.944868 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:23.945689 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:23.946558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:23.947103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:24.235590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:24.244495 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-525d9de6-e534-4503-95aa-fef7e21d0772 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1209 microversion: 2.1 time: 0.313652 May 30 12:15:24.245092 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 514/1068] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:23 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1209 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:25.261715 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:25.262441 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:25.274481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:25.275297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:25.276310 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:25.276904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:25.417792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:25.428785 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-97403e3f-0634-4c76-9aa2-44cb4a3e9849 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.170550 May 30 12:15:25.432198 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 555/1069] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:25 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:25.664620 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-b27cb43d-dabc-4557-a56a-702746feabdc req-ba8c425d-2688-43ec-936f-345d5bd628c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f", "tag": "6b81b1de-74b0-48e0-9278-fb125c59d5bb"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:25.674770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b27cb43d-dabc-4557-a56a-702746feabdc req-ba8c425d-2688-43ec-936f-345d5bd628c0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:25.675288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-b27cb43d-dabc-4557-a56a-702746feabdc req-ba8c425d-2688-43ec-936f-345d5bd628c0 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:25.688689 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-b27cb43d-dabc-4557-a56a-702746feabdc req-ba8c425d-2688-43ec-936f-345d5bd628c0 service nova] Creating event network-changed:6b81b1de-74b0-48e0-9278-fb125c59d5bb for instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f on hv-cinder-83979 May 30 12:15:25.694708 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-b27cb43d-dabc-4557-a56a-702746feabdc req-ba8c425d-2688-43ec-936f-345d5bd628c0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035145 May 30 12:15:25.695319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 515/1070] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:26.447116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:26.447943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:26.457203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:26.457912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:26.458806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:26.459541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:26.603018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:26.610507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ef505eac-e5a7-45e2-94fe-8918fb3a6f8f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.168142 May 30 12:15:26.611653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 556/1071] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:26 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:27.630664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:27.631299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:27.637508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:27.637960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:27.638730 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:27.639168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:27.772226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:27.779713 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-d058bcb0-4b78-4030-9e70-9308ffe60e11 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.154530 May 30 12:15:27.780310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 516/1072] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:27 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:28.796389 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:28.797003 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:28.804065 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:28.804521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:28.805284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:28.805717 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:28.933458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:28.940792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e5c46ba9-df66-405a-abb8-94a7c1e119a6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.148207 May 30 12:15:28.941354 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 557/1073] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:28 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:29.957438 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:29.958055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:29.964652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:29.965052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:29.965819 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:29.966258 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:30.099056 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:30.106742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-4af212e6-e04c-4e2f-853c-63416b717af3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.153335 May 30 12:15:30.107304 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 517/1074] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:29 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:31.051915 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:31.052541 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:31.058891 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:31.059338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:31.060139 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:31.060567 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:31.124067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:31.124600 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:31.131677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:31.132158 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:31.132930 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:31.133369 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:31.197464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:31.206163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-741a36b2-ce25-47c7-ab6f-e59fb97363e2 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1594 microversion: 2.1 time: 0.157444 May 30 12:15:31.206746 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 558/1075] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:31 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:31.276880 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:31.285256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-662e2aa0-3417-4393-8582-bf5067a7943a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1276 microversion: 2.1 time: 0.164975 May 30 12:15:31.285952 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 518/1076] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:31 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1276 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:15:32.302975 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:32.303801 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:32.310670 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:32.311366 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:32.312449 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:32.312888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:32.524835 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:32.532436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a92496da-c3c1-4273-b999-67733e58fc6e tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.233987 May 30 12:15:32.533008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 559/1077] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:32 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:33.093411 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-5bcb4241-ac97-46f3-8607-5e3c2a60a55e req-ae46fc4b-48d3-4218-9dd7-1bceda580e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:33.100242 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.101136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.105946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5bcb4241-ac97-46f3-8607-5e3c2a60a55e req-ae46fc4b-48d3-4218-9dd7-1bceda580e71 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:33.106397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5bcb4241-ac97-46f3-8607-5e3c2a60a55e req-ae46fc4b-48d3-4218-9dd7-1bceda580e71 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:33.119906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-5bcb4241-ac97-46f3-8607-5e3c2a60a55e req-ae46fc4b-48d3-4218-9dd7-1bceda580e71 service nova] Creating event network-changed:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:15:33.125052 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-5bcb4241-ac97-46f3-8607-5e3c2a60a55e req-ae46fc4b-48d3-4218-9dd7-1bceda580e71 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035590 May 30 12:15:33.125732 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 519/1078] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:33.551537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:33.552778 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:33.558212 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:33.563965 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:33.564859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:33.566521 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:33.567129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:33.755593 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:33.764557 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-409d5afd-f35f-449b-a7c3-2fe758d746e1 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.218809 May 30 12:15:33.772183 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 560/1079] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:33 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:34.426742 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1901569678"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:34.427374 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:34.434157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:34.434866 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:34.435961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:34.436475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:34.578854 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.network.security_group_api [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Adding security group bf91e1be-aecb-444f-a666-7517e0ed1a53 to port e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 May 30 12:15:34.788324 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:34.788940 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:34.795701 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:34.796431 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:34.797204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:34.797640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:34.949207 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:34.958476 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-22abcfa5-790d-433a-8a6f-6e15b6eefd69 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.173787 May 30 12:15:34.959582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 561/1080] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:34 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:15:35.129850 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fed5ab37-37dc-4be5-af5b-2a7f2d184db4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action" status: 202 len: 0 microversion: 2.1 time: 0.708620 May 30 12:15:35.130770 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 520/1081] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:15:34 2022] POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:15:35.145977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-fe5dc0e0-8a2c-4602-a687-56d09d761923 req-69ae6390-b511-4e2d-9bb5-4d5f5f92f471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:35.147475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:35.148490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:35.154225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-fe5dc0e0-8a2c-4602-a687-56d09d761923 req-69ae6390-b511-4e2d-9bb5-4d5f5f92f471 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:35.156116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:35.156781 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-fe5dc0e0-8a2c-4602-a687-56d09d761923 req-69ae6390-b511-4e2d-9bb5-4d5f5f92f471 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:35.157036 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:35.157889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:35.158458 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:35.174975 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-fe5dc0e0-8a2c-4602-a687-56d09d761923 req-69ae6390-b511-4e2d-9bb5-4d5f5f92f471 service nova] Creating event network-changed:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:15:35.180480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-fe5dc0e0-8a2c-4602-a687-56d09d761923 req-69ae6390-b511-4e2d-9bb5-4d5f5f92f471 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038651 May 30 12:15:35.182675 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 521/1082] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:15:35.464808 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:35.476296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8e6317c0-410a-4e4b-ae07-c35c82648ccb tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1760 microversion: 2.1 time: 0.340461 May 30 12:15:35.478014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 562/1083] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:35 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1760 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:35.976616 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:35.978635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:35.986077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:35.986669 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:35.987464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:35.988016 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:36.129956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:36.137450 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-00dc798f-efa9-4978-97e0-1c3acaada228 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.166614 May 30 12:15:36.138011 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 522/1084] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:35 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:37.154273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:37.154891 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:37.161532 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:37.161978 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:37.162743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:37.163180 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:37.301054 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:37.308706 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-334477b7-0ecf-4307-a544-81312328705c tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.158103 May 30 12:15:37.309203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 563/1085] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:37 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:38.327692 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:38.328342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:38.334878 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:38.335346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:38.336141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:38.336585 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:38.474762 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:38.484036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-3737e536-3906-4c26-b22f-2c752dece6b7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.159978 May 30 12:15:38.484871 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 523/1086] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:38 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:39.501142 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:39.502285 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:39.508892 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:39.509349 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:39.510118 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:39.510558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:39.640899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:39.648435 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-849854bf-4430-4f6b-951f-58e4c09c7a41 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.151091 May 30 12:15:39.649006 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 564/1087] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:39 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:40.666343 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:40.668964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:40.676476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:40.676810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:40.677598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:40.678043 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:40.823325 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:40.831301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bc20a68c-79ff-4d17-95f0-7c915febc4a9 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.169914 May 30 12:15:40.831916 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 524/1088] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:40 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:41.849070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:41.850284 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:41.856874 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:41.857424 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:41.858488 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:41.859102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:42.000969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:42.008638 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-361240e1-0915-43fe-ae92-7682010ab2cc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.164633 May 30 12:15:42.009204 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 565/1089] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:41 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:43.024943 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:43.025564 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:43.032476 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:43.033185 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:43.034703 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:43.035312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:43.206013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:43.214330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-cb324eff-7021-4017-b4d3-9af5a36979a3 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.193140 May 30 12:15:43.215062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 525/1090] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:43 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:44.231556 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:44.232199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:44.239015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:44.239480 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:44.240448 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:44.240883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:44.379510 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:44.395861 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-4a346529-a93f-4ff2-a773-f1d839a4c350 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.167894 May 30 12:15:44.396538 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 566/1091] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:44 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:45.413099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:45.413706 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:45.421371 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:45.422789 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:45.423578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:45.424797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:45.571077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:45.578518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-da13a8fb-48c1-4585-800a-659348832713 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.169850 May 30 12:15:45.579173 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 526/1092] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:45 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:46.595085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:46.596102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:46.597889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=31 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.603461 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:46.603935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:46.604769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:46.605152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:46.607992 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:46.746619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:46.755536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6cf33110-f5bb-47d8-b258-3de35defad59 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.164890 May 30 12:15:46.756264 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 567/1093] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:46 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:47.280638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-1b232c0d-e200-47a3-85e6-ff3173f21828 req-8dece9be-aae5-4db6-b6b5-a773fc61b23d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f", "name": "network-vif-plugged", "status": "completed", "tag": "6b81b1de-74b0-48e0-9278-fb125c59d5bb"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:47.290026 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-1b232c0d-e200-47a3-85e6-ff3173f21828 req-8dece9be-aae5-4db6-b6b5-a773fc61b23d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:47.290812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-1b232c0d-e200-47a3-85e6-ff3173f21828 req-8dece9be-aae5-4db6-b6b5-a773fc61b23d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:47.304090 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-1b232c0d-e200-47a3-85e6-ff3173f21828 req-8dece9be-aae5-4db6-b6b5-a773fc61b23d service nova] Creating event network-vif-plugged:6b81b1de-74b0-48e0-9278-fb125c59d5bb for instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f on hv-cinder-83979 May 30 12:15:47.310544 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-1b232c0d-e200-47a3-85e6-ff3173f21828 req-8dece9be-aae5-4db6-b6b5-a773fc61b23d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033871 May 30 12:15:47.311541 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 527/1094] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:15:47.773341 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:47.773813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:47.780530 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:47.781047 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:47.781728 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:47.782163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:47.920026 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:47.929437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-87370992-f4b3-4646-99da-3541cd1cebf7 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.159957 May 30 12:15:47.930011 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 568/1095] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:47 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:48.947896 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:48.948594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:48.954728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:48.955183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:48.956597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:48.957034 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:49.096980 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:49.104665 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7f30391d-077d-4e86-9b49-bc80bd7c4719 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1264 microversion: 2.1 time: 0.161469 May 30 12:15:49.105230 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 528/1096] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:48 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:50.122430 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:50.123055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:50.130563 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:50.131033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:50.131803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:50.132262 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:50.265589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:50.273607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d074af7c-d601-4ef6-8b9a-0cbce438208d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1450 microversion: 2.1 time: 0.155287 May 30 12:15:50.274179 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 569/1097] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:50 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:50.289979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:50.290591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:50.296908 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:50.297355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:50.298108 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:50.298539 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:50.437831 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:50.446103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e7dfeaad-2084-48e4-978c-804f41741a0d tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1450 microversion: 2.1 time: 0.160042 May 30 12:15:50.446659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 529/1098] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:50 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:52.290244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-6b83f09c-8a18-41a0-948a-6d3bd17643a0 req-cc30b503-d351-48ff-894f-6724e090b192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f", "tag": "6b81b1de-74b0-48e0-9278-fb125c59d5bb"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:52.300875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-6b83f09c-8a18-41a0-948a-6d3bd17643a0 req-cc30b503-d351-48ff-894f-6724e090b192 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:52.302733 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-6b83f09c-8a18-41a0-948a-6d3bd17643a0 req-cc30b503-d351-48ff-894f-6724e090b192 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:52.316659 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-6b83f09c-8a18-41a0-948a-6d3bd17643a0 req-cc30b503-d351-48ff-894f-6724e090b192 service nova] Creating event network-changed:6b81b1de-74b0-48e0-9278-fb125c59d5bb for instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f on hv-cinder-83979 May 30 12:15:52.324231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-6b83f09c-8a18-41a0-948a-6d3bd17643a0 req-cc30b503-d351-48ff-894f-6724e090b192 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 May 30 12:15:52.325754 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 570/1099] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:15:56.058444 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:15:56.059322 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:56.061936 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:56.068321 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:56.068807 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:56.069595 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:56.070036 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:56.074183 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=81 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:15:56.147397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6c22f414-009c-418c-a97a-2c96e47415f4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action" status: 202 len: 0 microversion: 2.1 time: 0.093013 May 30 12:15:56.148079 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 530/1100] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:15:56 2022] POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:15:56.157970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:56.159267 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:56.166617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:56.167187 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:56.168048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:56.168547 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:56.618242 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:56.626680 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-acc75626-89e5-48f3-8b8b-0aa0b245e0ca tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1752 microversion: 2.1 time: 0.473391 May 30 12:15:56.627261 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 571/1101] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:56 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1752 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:57.645635 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:57.646341 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:57.653926 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:57.654380 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:57.655225 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:57.655698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:57.800358 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:57.808700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-555cf32c-5fc3-4036-9660-93d57059fbe1 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.167932 May 30 12:15:57.809297 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 531/1102] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:57 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:15:58.826450 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:15:58.827057 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:15:58.834214 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:58.834694 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:58.835487 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:15:58.835952 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:15:58.984766 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:15:58.992838 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ef30bf50-b5cd-465f-beba-f60feac255f7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.170644 May 30 12:15:58.994093 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 572/1103] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:15:58 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:00.011659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:00.012236 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:00.018785 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:00.019237 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:00.020038 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:00.020479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:00.169402 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:00.177487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-95c8543c-16de-4d2f-a55d-6437f45718c4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.169781 May 30 12:16:00.178051 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 532/1104] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:00 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:01.194775 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:01.195414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:01.201973 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:01.202419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:01.203173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:01.203605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:01.355894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:01.365562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ed8f6a6f-7af2-4296-97f1-5fbbaac53f23 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.174486 May 30 12:16:01.366246 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 573/1105] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:01 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:02.383700 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:02.384311 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:02.392070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:02.392522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:02.393291 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:02.393728 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:02.545323 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:02.553200 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-46add5a3-62cb-4b49-911b-45e8bf66f28f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.173472 May 30 12:16:02.553756 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 533/1106] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:02 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:03.569414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:03.570030 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:03.577295 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:03.577742 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:03.578508 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:03.579089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:03.728257 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:03.736838 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-bedaf395-cff9-4472-ba6b-995b99ac6e6a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.171179 May 30 12:16:03.737334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 574/1107] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:03 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:04.754960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:04.755604 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:04.762806 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:04.763253 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:04.764118 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:04.764569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:04.913590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:04.922315 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7d2e941f-0002-4669-9302-96c4b596ae2a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.171206 May 30 12:16:04.922888 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 534/1108] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:04 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:05.940588 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:05.941199 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:05.947580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:05.948061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:05.948812 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:05.950083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:06.102106 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:06.110095 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-deb14cbc-d651-4215-a695-d5167700fad3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.173364 May 30 12:16:06.110662 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 575/1109] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:05 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:16:07.126950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:07.127570 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:07.134281 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:07.134734 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:07.135504 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:07.135979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:07.284924 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:07.293490 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c9250256-88c5-42f8-99dd-8bf4f95e8773 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.169852 May 30 12:16:07.294073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 535/1110] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:07 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:08.311206 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:08.311743 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:08.319055 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:08.319533 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:08.320334 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:08.320769 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:08.473756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:08.483018 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-daeac708-e53f-4b8b-abbb-c376d1b1baed tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.176425 May 30 12:16:08.483589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 576/1111] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:08 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:09.501251 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:09.501912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:09.508575 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:09.509029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:09.509874 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:09.510319 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:09.664256 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:09.673033 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-59c5c058-cd19-4523-9dfd-36987c89d499 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.176767 May 30 12:16:09.674301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 536/1112] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:09 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:10.691305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:10.691951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:10.698558 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:10.699007 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:10.699911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:10.700370 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:10.848143 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:10.856901 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1f6a7c58-aa10-455e-87ff-7e8db53ad14c tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.169667 May 30 12:16:10.857473 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 577/1113] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:10 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:11.874470 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:11.875085 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:11.881632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:11.882083 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:11.882856 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:11.883294 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:12.025940 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:12.034906 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-312fb06e-b97a-4ef7-982e-ac099f0f991f tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.164832 May 30 12:16:12.035452 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 537/1114] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:11 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:13.051989 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:13.052604 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:13.058916 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:13.060116 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:13.060861 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:13.061296 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:13.206786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:13.216089 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d297623f-662b-4fef-b68c-272598d7c157 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.167414 May 30 12:16:13.216946 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 578/1115] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:13 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:14.234543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:14.235736 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:14.242597 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:14.243257 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:14.244226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:14.244858 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:14.450376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:14.458682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-7b7aa8fe-8a48-418f-9dd9-4e361f54b575 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.228604 May 30 12:16:14.459262 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 538/1116] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:14 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:15.476898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:15.477500 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:15.485380 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:15.485824 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:15.486603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:15.487038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:15.654948 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:15.664249 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a9e2304b-8814-42f0-942e-01aac724f8c7 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.191370 May 30 12:16:15.664828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 579/1117] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:15 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:16.681689 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:16.682310 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:16.689077 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:16.689534 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:16.690316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:16.690762 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:16.834602 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:16.844560 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b939cf16-4d7d-4556-97ab-a7e7766a3f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.166733 May 30 12:16:16.845293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 539/1118] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:16 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:17.863507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:17.864150 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:17.866580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=26 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:17.872045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:17.872503 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:17.873270 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:17.873705 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:17.877795 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=74 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:18.018085 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:18.025887 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-55caeb8d-ca18-41b4-ae38-2a3b0ccee0b0 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.166215 May 30 12:16:18.026490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 580/1119] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:17 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:19.042427 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:19.043047 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:19.050155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:19.050607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:19.051378 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:19.051826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:19.190001 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:19.197840 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f8a24acb-9988-45ce-bdea-8eeb79b80695 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.159250 May 30 12:16:19.198410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 540/1120] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:19 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:20.214364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:20.214968 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:20.222725 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:20.223172 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:20.223949 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:20.224385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:20.370387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:20.379084 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-58caea63-4a25-45be-a6cb-6ad4fcce2580 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1757 microversion: 2.1 time: 0.168505 May 30 12:16:20.379656 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 581/1121] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:20 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:21.397212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:21.397835 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:21.404717 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:21.405171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:21.405939 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:21.406377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:21.553851 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:16:21.562348 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-e475c988-5d0e-463a-8447-40788874a8f3 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1760 microversion: 2.1 time: 0.168867 May 30 12:16:21.562929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 541/1122] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:16:21 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:16:41.814159 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:16:41.814942 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Mon May 30 12:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:16:48.816823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=3 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.817576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=11 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:48.985826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-375beb64-7384-4b54-9eed-1c009beb5f4d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Action: 'create', calling method: .version_select at 0x7f61a1ee2940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1626932515", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwdZ/u8jqBbtLNDLjJL5PDGs5YZmPXsfAnCmCzEOEsU9FGqTH/bLxccgNtpo2U1f3d1gSYtuQJ+D94Pblbq074GD6qZDBqqVRLMhRwcGfrQbvZ4kyamfiv23LlCtiA+ig=="}} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:49.000004 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-375beb64-7384-4b54-9eed-1c009beb5f4d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Getting quotas for project cc29531ccae24475ab6b50e2cc2e5d48. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:16:49.003997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.quota [None req-375beb64-7384-4b54-9eed-1c009beb5f4d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Getting quotas for user 0eb80aad1ad74eb4b0a28b1e686ecfab and project cc29531ccae24475ab6b50e2cc2e5d48. Resources: {'key_pairs'} {{(pid=117705) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:16:49.030592 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-375beb64-7384-4b54-9eed-1c009beb5f4d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.218317 May 30 12:16:49.031617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 582/1123] 10.222.0.41 () {60 vars in 1158 bytes} [Mon May 30 12:16:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:16:57.160448 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1901569678"}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:57.161049 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:57.163342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=23 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:57.164025 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:57.170168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:57.170624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:57.171404 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:57.171872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:57.406280 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.network.security_group_api [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Removing security group bf91e1be-aecb-444f-a666-7517e0ed1a53 from port e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 May 30 12:16:57.803150 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8fa63025-344e-44ec-9f98-a17c10616831 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action" status: 202 len: 0 microversion: 2.1 time: 0.646353 May 30 12:16:57.807067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 542/1124] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:16:57 2022] POST /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/action => generated 0 bytes in 648 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:16:57.823332 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-a4906e86-6008-47ce-ab65-e96fec21f7ec req-d9f773ef-9d40-47a8-9564-88c2251ec0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:57.856526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-a4906e86-6008-47ce-ab65-e96fec21f7ec req-d9f773ef-9d40-47a8-9564-88c2251ec0d8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:57.857244 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-a4906e86-6008-47ce-ab65-e96fec21f7ec req-d9f773ef-9d40-47a8-9564-88c2251ec0d8 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:57.879796 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-a4906e86-6008-47ce-ab65-e96fec21f7ec req-d9f773ef-9d40-47a8-9564-88c2251ec0d8 service nova] Creating event network-changed:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:16:57.887203 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-a4906e86-6008-47ce-ab65-e96fec21f7ec req-d9f773ef-9d40-47a8-9564-88c2251ec0d8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077154 May 30 12:16:57.887493 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 583/1125] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:16:59.243199 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:59.243699 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:59.250024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:59.250480 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:59.251255 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:59.252414 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:59.337621 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lazy-loading 'services' on Instance uuid 62a79eb8-632d-4599-ada8-e73a288c8237 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:16:59.420084 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-215bed7f-eaf7-46aa-bc62-cb24fa25d255 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments/23d1a79f-2933-4317-bd28-81394fa3f8c3" status: 202 len: 0 microversion: 2.1 time: 0.181066 May 30 12:16:59.421055 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 543/1126] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:16:59 2022] DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments/23d1a79f-2933-4317-bd28-81394fa3f8c3 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:16:59.431160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:16:59.432205 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:16:59.434627 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=4 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:16:59.447102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:59.447549 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:59.448356 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:59.448957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:59.480461 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0c914d1d-bfa3-46d1-9601-af72c7f9cde4 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053581 May 30 12:16:59.481040 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 584/1127] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:16:59 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:16:59.903039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-6972af65-0b17-48a8-9ad3-2d46fe2cb3ad req-347fd7c0-be05-4335-aa16-eb95df2e279d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:16:59.914030 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-6972af65-0b17-48a8-9ad3-2d46fe2cb3ad req-347fd7c0-be05-4335-aa16-eb95df2e279d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:16:59.914479 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-6972af65-0b17-48a8-9ad3-2d46fe2cb3ad req-347fd7c0-be05-4335-aa16-eb95df2e279d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:16:59.927409 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-6972af65-0b17-48a8-9ad3-2d46fe2cb3ad req-347fd7c0-be05-4335-aa16-eb95df2e279d service nova] Creating event network-changed:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:16:59.934162 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-6972af65-0b17-48a8-9ad3-2d46fe2cb3ad req-347fd7c0-be05-4335-aa16-eb95df2e279d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035357 May 30 12:16:59.934767 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 544/1128] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:00.492304 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:00.493232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:00.499658 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:00.500165 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:00.500937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:00.501888 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:00.530273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-81f89ce8-8f3e-4f2a-a813-5464c84de100 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041862 May 30 12:17:00.530828 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 585/1129] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:00 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:01.543039 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:01.544115 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:01.551114 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:01.551569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:01.552367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:01.552809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:01.582582 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0357246f-08f1-4270-9b0b-7fa7404c89e6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 May 30 12:17:01.583146 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 545/1130] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:01 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:02.594078 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:02.595168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:02.602845 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:02.603297 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:02.604102 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:02.604600 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:02.633367 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-045a463c-0ba0-42f2-a342-fcb3162e3033 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 May 30 12:17:02.633922 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 586/1131] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:02 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:03.645216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:03.646136 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:03.652569 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:03.653019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:03.653773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:03.654207 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:03.683518 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fc1f1f88-5739-484b-8172-9cd423e7d9b6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042752 May 30 12:17:03.684107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 546/1132] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:03 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:04.696003 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:04.696933 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:04.703346 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:04.703799 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:04.704607 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:04.705048 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:04.732873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-9f753e91-355f-490a-8296-ac0b9cee6f03 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040853 May 30 12:17:04.733415 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 587/1133] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:04 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:04.994974 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:17:04.995545 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:17:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:17:05.745029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:05.745968 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:05.753367 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:05.753812 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:05.754599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:05.755019 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:05.783679 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b8bf7824-0644-45b3-a482-1d0a87af748a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042697 May 30 12:17:05.784286 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 547/1134] 10.222.0.41 () {58 vars in 1301 bytes} [Mon May 30 12:17:05 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 30 12:17:05.793859 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:05.794351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:05.801938 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:05.802382 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:05.803131 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:05.803562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:05.976100 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] HTTP exception thrown: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 is not attached to volume 23d1a79f-2933-4317-bd28-81394fa3f8c3 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Request method failure captured: May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments/23d1a79f-2933-4317-bd28-81394fa3f8c3 HTTP/1.1 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLUZD0t9Uo4sUJdWOUFFnE6-AlejsfqKwyXejMpa0svAUTeGgSaEIWj3vVb7NoGA-njqWcmkPc311Kj0jktgreRXLtwgZkXwd47qEn_ZiLlkOxrKLhB9uxMG-FI-pXaqUcAJvXuo4r5F4Ku5kfeHdruTD15uTCd3xloclRSusY7QLck May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: cd1f7d3f6294439090a64d1b442e0789 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:17:05.983113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cd1f7d3f6294439090a64d1b442e0789", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: cd1f7d3f6294439090a64d1b442e0789 May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-TestMinimumBasicScenario-1658014495-project May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: 91cb81b73de1405899bfa73cecb8e1ae May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-TestMinimumBasicScenario-1658014495-project May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:17:05.984911 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 is not attached to volume 23d1a79f-2933-4317-bd28-81394fa3f8c3 May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'server_id': '62a79eb8-632d-4599-ada8-e73a288c8237', 'id': '23d1a79f-2933-4317-bd28-81394fa3f8c3'} May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 23d1a79f-2933-4317-bd28-81394fa3f8c3. May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:05.985794 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 is not attached to volume 23d1a79f-2933-4317-bd28-81394fa3f8c3 May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 is not attached to volume 23d1a79f-2933-4317-bd28-81394fa3f8c3 May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:05.987110 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Returning 404 to user: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 is not attached to volume 23d1a79f-2933-4317-bd28-81394fa3f8c3 {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:05.988173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-a6f59964-53a3-4e15-bf37-7c7e61c07de5 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments/23d1a79f-2933-4317-bd28-81394fa3f8c3" status: 404 len: 154 microversion: 2.1 time: 0.194666 May 30 12:17:05.988173 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 588/1135] 10.222.0.41 () {58 vars in 1415 bytes} [Mon May 30 12:17:05 2022] DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237/os-volume_attachments/23d1a79f-2933-4317-bd28-81394fa3f8c3 => generated 154 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:17:06.277759 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1510314117", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1626932515", "security_groups": [{"name": "tempest-secgroup-smoke-1486306651"}], "networks": [{"uuid": "3685edb5-3421-4c95-bcbc-433943519b61"}], "block_device_mapping_v2": [{"uuid": "96afaf2a-55eb-41e0-a5d5-4079519c4e42", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:06.399301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.network.neutron [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] validate_networks() for [('3685edb5-3421-4c95-bcbc-433943519b61', None, None, None, None, None)] {{(pid=117706) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 30 12:17:06.772080 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Flavor limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 30 12:17:06.772508 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Image limits 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 30 12:17:06.772985 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Flavor pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 30 12:17:06.773396 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Image pref 0:0:0 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 30 12:17:06.773810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.virt.hardware [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117706) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 30 12:17:06.785346 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:06.785826 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:06.786626 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:06.787064 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:06.803096 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Getting quotas for project cc29531ccae24475ab6b50e2cc2e5d48. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 30 12:17:06.807006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.quota [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Getting quotas for user 0eb80aad1ad74eb4b0a28b1e686ecfab and project cc29531ccae24475ab6b50e2cc2e5d48. Resources: {'cores', 'ram', 'instances'} {{(pid=117706) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 30 12:17:06.864219 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Going to run 1 instances... {{(pid=117706) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 30 12:17:06.866317 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='96afaf2a-55eb-41e0-a5d5-4079519c4e42',volume_size=None,volume_type=None)] {{(pid=117706) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 30 12:17:06.996206 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6057cb42-1881-408a-9fd2-e515f7fd773a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722295 May 30 12:17:06.996845 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 548/1136] 10.222.0.41 () {60 vars in 1146 bytes} [Mon May 30 12:17:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 30 12:17:07.007076 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-653674c3-54c3-4b5b-aceb-5144869a26f0 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:07.007883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-653674c3-54c3-4b5b-aceb-5144869a26f0 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:07.062997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-653674c3-54c3-4b5b-aceb-5144869a26f0 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:07.071371 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-653674c3-54c3-4b5b-aceb-5144869a26f0 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1089 microversion: 2.1 time: 0.068119 May 30 12:17:07.071960 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 589/1137] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:07 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:07.141130 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:07.141810 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:07.149475 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:07.149929 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:07.150704 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:07.151171 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:07.175910 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:17:07.252357 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-8e86f970-0432-4c5c-adb0-9991b9dc7052 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 204 len: 0 microversion: 2.1 time: 0.122774 May 30 12:17:07.253293 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 549/1138] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:17:07 2022] DELETE /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:17:07.262562 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:07.263437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:07.271002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:07.271387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:07.272258 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:07.272700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:07.406537 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:07.414009 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-926244ce-c8db-4f39-9d16-38a83f79cd54 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1554 microversion: 2.1 time: 0.155557 May 30 12:17:07.414587 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 590/1139] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:07 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:08.088961 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:08.089671 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:08.096590 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:08.097067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:08.097830 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:08.098267 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:08.161651 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:08.169030 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ce29964a-06e6-4d7c-b638-de1483aca3a5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1139 microversion: 2.1 time: 0.084294 May 30 12:17:08.169591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 550/1140] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:08 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1139 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:08.430790 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:08.431438 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:08.437958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:08.438408 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:08.439405 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:08.439869 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:08.570518 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:08.577970 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3db5a1e4-9d64-44fd-9d64-7a01d4d2d311 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1554 microversion: 2.1 time: 0.151143 May 30 12:17:08.578539 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 591/1141] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:08 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:09.186578 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:09.187201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:09.194128 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:09.194581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:09.195356 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:09.195797 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:09.259992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:09.268666 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-5a73e3db-1270-405e-972f-313523e36c78 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1131 microversion: 2.1 time: 0.086131 May 30 12:17:09.269831 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 551/1142] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:09 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1131 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:09.595756 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:09.596400 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:09.604163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:09.604809 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:09.605825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:09.606303 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:09.837832 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91cb81b73de1405899bfa73cecb8e1ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd1f7d3f6294439090a64d1b442e0789', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:09.854191 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-30931ff7-1f5d-4ba3-b1b8-4cfc5e59788a tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 200 len: 1554 microversion: 2.1 time: 0.262179 May 30 12:17:09.858846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 592/1143] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:09 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 1554 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:09.893099 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-ce21b8fb-895f-48be-a7fb-ab96db947d83 req-70bc367b-75e8-49e8-9ee9-b31b9b173c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62a79eb8-632d-4599-ada8-e73a288c8237", "name": "network-vif-deleted", "tag": "e21bcdd9-584e-4263-ac91-5d5ebaeba9b2"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:09.904586 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-ce21b8fb-895f-48be-a7fb-ab96db947d83 req-70bc367b-75e8-49e8-9ee9-b31b9b173c74 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:09.905035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-ce21b8fb-895f-48be-a7fb-ab96db947d83 req-70bc367b-75e8-49e8-9ee9-b31b9b173c74 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:09.918540 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-ce21b8fb-895f-48be-a7fb-ab96db947d83 req-70bc367b-75e8-49e8-9ee9-b31b9b173c74 service nova] Creating event network-vif-deleted:e21bcdd9-584e-4263-ac91-5d5ebaeba9b2 for instance 62a79eb8-632d-4599-ada8-e73a288c8237 on hv-cinder-83979 May 30 12:17:09.929285 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-ce21b8fb-895f-48be-a7fb-ab96db947d83 req-70bc367b-75e8-49e8-9ee9-b31b9b173c74 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040211 May 30 12:17:09.932216 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 552/1144] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:10.287216 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:10.287865 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:10.295311 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:10.295765 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:10.296589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:10.297027 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:10.389351 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:10.401015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e234e851-8017-4e31-a287-8759b0ca1616 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1205 microversion: 2.1 time: 0.118132 May 30 12:17:10.401700 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 593/1145] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:10 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1205 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:10.875420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:10.877431 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] [instance: 62a79eb8-632d-4599-ada8-e73a288c8237] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:10.883652 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:10.884141 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:10.884923 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:10.885532 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:10.901279 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] HTTP exception thrown: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Request method failure captured: May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 HTTP/1.1 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLUZD0t9Uo4sUJdWOUFFnE6-AlejsfqKwyXejMpa0svAUTeGgSaEIWj3vVb7NoGA-njqWcmkPc311Kj0jktgreRXLtwgZkXwd47qEn_ZiLlkOxrKLhB9uxMG-FI-pXaqUcAJvXuo4r5F4Ku5kfeHdruTD15uTCd3xloclRSusY7QLck May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: cd1f7d3f6294439090a64d1b442e0789 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:17:10.902935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cd1f7d3f6294439090a64d1b442e0789", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cd1f7d3f6294439090a64d1b442e0789"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: cd1f7d3f6294439090a64d1b442e0789 May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1658014495 May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestMinimumBasicScenario-1658014495-project May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 91cb81b73de1405899bfa73cecb8e1ae May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestMinimumBasicScenario-1658014495-project May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. May 30 12:17:10.905029 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '62a79eb8-632d-4599-ada8-e73a288c8237'} May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:10.905956 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. May 30 12:17:10.907809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:10.910191 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Returning 404 to user: Instance 62a79eb8-632d-4599-ada8-e73a288c8237 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:10.911071 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-912db697-a351-4905-935a-93903fdad430 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237" status: 404 len: 111 microversion: 2.1 time: 0.040360 May 30 12:17:10.911638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 553/1146] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:10 2022] GET /compute/v2.1/servers/62a79eb8-632d-4599-ada8-e73a288c8237 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:17:10.919810 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d0ae239a-5d79-4220-b1de-13dcc4ae30a6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] Calling method '.version_select at 0x7f61a1dc0d30>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:10.937813 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d0ae239a-5d79-4220-b1de-13dcc4ae30a6 tempest-TestMinimumBasicScenario-1658014495 tempest-TestMinimumBasicScenario-1658014495-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-772321380" status: 202 len: 0 microversion: 2.1 time: 0.021702 May 30 12:17:10.938489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 594/1147] 10.222.0.41 () {58 vars in 1268 bytes} [Mon May 30 12:17:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-772321380 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 30 12:17:11.422632 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:11.423576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-480525bb-8853-495f-90e5-d5a2f6c3bcb1 req-37c331cd-65bf-4a50-87a1-ad91eae92975 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:11.424628 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:11.436653 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:11.437672 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:11.438776 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:11.440290 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:11.441220 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-480525bb-8853-495f-90e5-d5a2f6c3bcb1 req-37c331cd-65bf-4a50-87a1-ad91eae92975 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:11.441723 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-480525bb-8853-495f-90e5-d5a2f6c3bcb1 req-37c331cd-65bf-4a50-87a1-ad91eae92975 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:11.463682 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-480525bb-8853-495f-90e5-d5a2f6c3bcb1 req-37c331cd-65bf-4a50-87a1-ad91eae92975 service nova] Creating event network-changed:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:17:11.472168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-480525bb-8853-495f-90e5-d5a2f6c3bcb1 req-37c331cd-65bf-4a50-87a1-ad91eae92975 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055120 May 30 12:17:11.476006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 554/1148] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:11.623442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:11.632833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1b9be957-7ac3-4d95-809e-384c96a4f257 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.215091 May 30 12:17:11.633981 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 595/1149] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:11 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:17:12.651507 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:12.652890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:12.659966 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:12.660428 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:12.661209 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:12.661653 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:12.812301 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:12.820656 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f55717c6-07ec-404e-84f5-67c7ad7874f5 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.173698 May 30 12:17:12.821377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 555/1150] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:12 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:13.838307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:13.838923 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:13.846644 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:13.847390 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:13.848369 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:13.848964 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:14.003630 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:14.011387 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-97ba48e5-6fb1-4e01-8892-0b1027deea86 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.177617 May 30 12:17:14.012008 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 596/1151] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:13 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:15.034469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:15.035062 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:15.043212 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:15.043640 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:15.044469 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:15.044912 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:15.200247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:15.208821 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-42e9cd7d-624f-4d66-9bad-5050e338b079 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.184124 May 30 12:17:15.209390 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 556/1152] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:15 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:16.226021 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:16.226571 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:16.232957 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:16.233398 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:16.234163 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:16.234597 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:16.422140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:16.430333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-0ff263da-4d63-42ce-84b9-4149132f66d7 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.208558 May 30 12:17:16.430913 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 597/1153] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:16 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:17.446514 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:17.447121 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:17.449571 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=2 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:17.450366 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell0:SELECT=6 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:17.456598 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:17.457040 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:17.457831 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:17.458269 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:17.598809 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:17.610127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-eefac090-9ecc-422a-a105-7a18f234d03a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.167371 May 30 12:17:17.611339 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 557/1154] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:17 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:18.627266 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:18.627908 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:18.629768 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell0:SELECT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:18.635635 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:18.636109 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:18.636873 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:18.637305 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:18.786071 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:18.793328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-db23224e-15e2-46e4-8fcc-aeb1105e9b13 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.170433 May 30 12:17:18.793883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 598/1155] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:18 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:19.810541 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:19.811157 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:19.818552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:19.819006 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:19.819774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:19.820383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:19.961068 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:19.968414 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c64707b3-ec2a-410b-9f3e-df7891a20b71 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.161782 May 30 12:17:19.968976 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 558/1156] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:19 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:20.986501 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:20.987141 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:20.989536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:20.995094 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:20.995544 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:20.996342 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:20.996777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:21.002617 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=81 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:21.131495 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:21.138896 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-dcbdae1d-1b1c-4dd2-b4d2-a489f90b9a92 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.157200 May 30 12:17:21.139457 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 599/1157] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:20 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:21.646667 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-5d839d4a-cca1-4faa-aff5-440f3642acf5 req-644d3301-e8c5-4f21-ac29-46d0729be297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "name": "network-vif-plugged", "status": "completed", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:21.655398 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5d839d4a-cca1-4faa-aff5-440f3642acf5 req-644d3301-e8c5-4f21-ac29-46d0729be297 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:21.655849 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-5d839d4a-cca1-4faa-aff5-440f3642acf5 req-644d3301-e8c5-4f21-ac29-46d0729be297 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:21.667387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-5d839d4a-cca1-4faa-aff5-440f3642acf5 req-644d3301-e8c5-4f21-ac29-46d0729be297 service nova] Creating event network-vif-plugged:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:17:21.672254 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-5d839d4a-cca1-4faa-aff5-440f3642acf5 req-644d3301-e8c5-4f21-ac29-46d0729be297 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030282 May 30 12:17:21.672837 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 559/1158] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:22.155877 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:22.156489 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:22.163922 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:22.164364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:22.165129 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:22.165582 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:22.294293 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:22.302256 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b1cb3c60-1063-49f9-869f-ba6638c70114 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1261 microversion: 2.1 time: 0.150181 May 30 12:17:22.302803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 600/1159] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:22 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:23.319972 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:23.320680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:23.326899 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:23.327354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:23.328153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:23.328594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:23.348625 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:23.465907 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:23.474825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fca0f29b-aa2b-43c8-83a5-c34a7b0dd619 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1445 microversion: 2.1 time: 0.159358 May 30 12:17:23.475381 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 560/1160] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:23 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1445 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:23.491345 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:23.491979 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:23.498336 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:23.498777 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:23.499531 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:23.499997 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:23.630601 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:23.638033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-224eb12a-f186-4680-8e85-4f51864fd490 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1445 microversion: 2.1 time: 0.150403 May 30 12:17:23.638603 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 601/1161] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:23 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:25.445332 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-dc7d8a32-3311-4e29-bd56-f72c792c68c9 req-ff51fa72-8320-4f5f-a959-7d2f96590c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:25.453695 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-dc7d8a32-3311-4e29-bd56-f72c792c68c9 req-ff51fa72-8320-4f5f-a959-7d2f96590c25 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:25.454735 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-dc7d8a32-3311-4e29-bd56-f72c792c68c9 req-ff51fa72-8320-4f5f-a959-7d2f96590c25 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:25.465580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-dc7d8a32-3311-4e29-bd56-f72c792c68c9 req-ff51fa72-8320-4f5f-a959-7d2f96590c25 service nova] Creating event network-changed:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:17:25.470902 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-dc7d8a32-3311-4e29-bd56-f72c792c68c9 req-ff51fa72-8320-4f5f-a959-7d2f96590c25 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028681 May 30 12:17:25.471487 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 561/1162] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:46.951426 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:46.952096 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:46.952490 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:46.953435 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=4 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:46.956328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=5 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:46.957152 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=17 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:17:46.963414 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:46.963889 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:46.964699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:46.965103 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:46.994263 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:17:47.082142 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-70d4c901-8aae-47f9-95f2-2d463f101c3f tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "DELETE /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 204 len: 0 microversion: 2.1 time: 0.134204 May 30 12:17:47.083113 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 602/1163] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:17:46 2022] DELETE /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:17:47.093273 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:47.094193 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:47.101619 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:47.102461 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:47.103254 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:47.110746 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-2d9d2fa6-dd6b-4f80-ab2c-6200212d5820 req-f92dbf35-6013-4381-b080-6e160042a2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f", "tag": "6b81b1de-74b0-48e0-9278-fb125c59d5bb"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:47.113899 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:47.124388 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2d9d2fa6-dd6b-4f80-ab2c-6200212d5820 req-f92dbf35-6013-4381-b080-6e160042a2da service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:47.124839 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2d9d2fa6-dd6b-4f80-ab2c-6200212d5820 req-f92dbf35-6013-4381-b080-6e160042a2da service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:47.137288 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-2d9d2fa6-dd6b-4f80-ab2c-6200212d5820 req-f92dbf35-6013-4381-b080-6e160042a2da service nova] Creating event network-changed:6b81b1de-74b0-48e0-9278-fb125c59d5bb for instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f on hv-cinder-83979 May 30 12:17:47.143072 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-2d9d2fa6-dd6b-4f80-ab2c-6200212d5820 req-f92dbf35-6013-4381-b080-6e160042a2da service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193042 May 30 12:17:47.144012 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 562/1164] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:47.258686 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:47.266157 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-c3ed3edc-7ad6-4f0b-9dae-d592dd260628 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1575 microversion: 2.1 time: 0.177003 May 30 12:17:47.267077 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 603/1165] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:47 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:48.284676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:48.285295 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:48.291964 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:48.292417 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:48.293181 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:48.293619 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:48.459580 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:48.467464 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-74d31fbe-7dd7-4107-8575-11516e66543b tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1575 microversion: 2.1 time: 0.187783 May 30 12:17:48.468067 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 563/1166] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:48 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:49.485015 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:49.485586 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:49.492161 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:49.492605 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:49.493374 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:49.493803 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:49.631122 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:49.639420 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-de84ee41-c2d4-43f1-ad60-309b9f4582e4 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1575 microversion: 2.1 time: 0.158297 May 30 12:17:49.640454 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 604/1167] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:49 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:17:49.827458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-21b620de-8c5b-4826-a192-29abfffb3113 req-20fb1de1-a522-4af4-bcf3-33f9cad08e34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f", "name": "network-vif-deleted", "tag": "6b81b1de-74b0-48e0-9278-fb125c59d5bb"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:49.836572 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-21b620de-8c5b-4826-a192-29abfffb3113 req-20fb1de1-a522-4af4-bcf3-33f9cad08e34 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:49.837024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-21b620de-8c5b-4826-a192-29abfffb3113 req-20fb1de1-a522-4af4-bcf3-33f9cad08e34 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:49.848511 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-21b620de-8c5b-4826-a192-29abfffb3113 req-20fb1de1-a522-4af4-bcf3-33f9cad08e34 service nova] Creating event network-vif-deleted:6b81b1de-74b0-48e0-9278-fb125c59d5bb for instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f on hv-cinder-83979 May 30 12:17:49.853801 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-21b620de-8c5b-4826-a192-29abfffb3113 req-20fb1de1-a522-4af4-bcf3-33f9cad08e34 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090755 May 30 12:17:49.854382 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 564/1168] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:50.655935 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:50.656615 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:50.663364 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:50.663824 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:50.664629 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:50.665067 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:50.695201 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:50.695650 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:50.696133 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.objects.instance [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lazy-loading 'fault' on Instance uuid 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f {{(pid=117705) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:17:50.740523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:50.748178 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ba2ced7c-cf28-46ce-afba-63533c38887a tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 200 len: 1229 microversion: 2.1 time: 0.096131 May 30 12:17:50.748806 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 605/1169] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:50 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:51.766946 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:51.767744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:51.774576 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:51.775027 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:51.775794 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:51.776265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:51.789558 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] HTTP exception thrown: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Request method failure captured: May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f HTTP/1.1 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLPaiUo-iZsI3esD_Btcj0msMfUq7z2Im8pUhaM79a_hdPprYsxdvvKz16SA4GVq0dWoP5PbqNXVudvKetykpubpYnqQuaucjY7YZ1n6N_EKadx65M0W2XlMA-a8WsewJJek9lJjcGAd0_aaR9SCZC1zmH-yEWz_C82wSNkMsy9Cmo8 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:17:51.791246 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4249e846c5d54876a6ed97678450c1d2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: f7e7ce32b4c0457196c8765d6c5ada7e May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. May 30 12:17:51.793070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f'} May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:51.794035 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. May 30 12:17:51.795664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:51.797733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Returning 404 to user: Instance 04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:51.797733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f77900c1-d038-42bb-a8b3-b4541c7bc299 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f" status: 404 len: 111 microversion: 2.1 time: 0.029923 May 30 12:17:51.797733 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 565/1170] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:51 2022] GET /compute/v2.1/servers/04c09ad8-2d02-4bbf-8d9f-6e67c5adab6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:17:54.833789 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-2415f6d3-3a60-4bfb-90d9-0ad089e6467b req-a8484d24-352c-42b6-b7e9-ea959e3bcc7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd07025-c284-41b4-89d5-fb7f33d3cce3", "tag": "c093c7fc-4dd4-4446-8948-0ee7b0bc65bd"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:54.841542 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:54.842079 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:54.842977 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2415f6d3-3a60-4bfb-90d9-0ad089e6467b req-a8484d24-352c-42b6-b7e9-ea959e3bcc7d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:54.843421 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2415f6d3-3a60-4bfb-90d9-0ad089e6467b req-a8484d24-352c-42b6-b7e9-ea959e3bcc7d service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:54.848333 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:54.848764 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:54.849793 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:54.850232 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:54.856458 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-2415f6d3-3a60-4bfb-90d9-0ad089e6467b req-a8484d24-352c-42b6-b7e9-ea959e3bcc7d service nova] Creating event network-changed:c093c7fc-4dd4-4446-8948-0ee7b0bc65bd for instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 on hv-cinder-83979 May 30 12:17:54.863247 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-2415f6d3-3a60-4bfb-90d9-0ad089e6467b req-a8484d24-352c-42b6-b7e9-ea959e3bcc7d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032625 May 30 12:17:54.863774 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 566/1171] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:54.876709 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Going to try to terminate instance {{(pid=117705) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:17:54.966699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-e185ddc7-eb69-4b99-9842-27718bf6c3b6 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 204 len: 0 microversion: 2.1 time: 0.138750 May 30 12:17:54.970481 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 606/1172] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:17:54 2022] DELETE /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:17:54.978314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:54.979178 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:54.986626 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:54.987070 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:54.987872 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:54.988312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:55.123224 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:55.131155 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-38b96487-4b07-4e48-a311-89134218a679 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1575 microversion: 2.1 time: 0.157326 May 30 12:17:55.132088 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 567/1173] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:54 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:56.149169 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:56.149902 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:56.156910 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:56.157350 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:56.158148 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:56.158652 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:56.293860 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:56.301738 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-8bf5c89d-f1df-405c-a30e-a90eb216c5dc tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1575 microversion: 2.1 time: 0.156816 May 30 12:17:56.302319 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 607/1174] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:56 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:57.319592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:57.320365 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:57.327228 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:57.327677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:57.328679 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:57.329202 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:57.417931 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7e7ce32b4c0457196c8765d6c5ada7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4249e846c5d54876a6ed97678450c1d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:17:57.426024 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-0293f33f-7ea6-4c48-a75b-d58a8e55e507 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 200 len: 1390 microversion: 2.1 time: 0.110551 May 30 12:17:57.426593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 568/1175] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:57 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:17:57.465826 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-b65b6347-cdc3-43cc-99e2-2c48d600474c req-be79f316-5215-431b-864f-d0277700f5cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd07025-c284-41b4-89d5-fb7f33d3cce3", "name": "network-vif-deleted", "tag": "c093c7fc-4dd4-4446-8948-0ee7b0bc65bd"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:17:57.477460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b65b6347-cdc3-43cc-99e2-2c48d600474c req-be79f316-5215-431b-864f-d0277700f5cf service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:57.477912 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-b65b6347-cdc3-43cc-99e2-2c48d600474c req-be79f316-5215-431b-864f-d0277700f5cf service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:57.490640 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-b65b6347-cdc3-43cc-99e2-2c48d600474c req-be79f316-5215-431b-864f-d0277700f5cf service nova] Creating event network-vif-deleted:c093c7fc-4dd4-4446-8948-0ee7b0bc65bd for instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 on hv-cinder-83979 May 30 12:17:57.496088 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-b65b6347-cdc3-43cc-99e2-2c48d600474c req-be79f316-5215-431b-864f-d0277700f5cf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034168 May 30 12:17:57.496958 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 608/1176] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:17:58.443965 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:58.444650 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 3cd07025-c284-41b4-89d5-fb7f33d3cce3] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:58.451170 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.451555 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.452364 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.452804 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.466870 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] HTTP exception thrown: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Request method failure captured: May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 HTTP/1.1 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLPaiUo-iZsI3esD_Btcj0msMfUq7z2Im8pUhaM79a_hdPprYsxdvvKz16SA4GVq0dWoP5PbqNXVudvKetykpubpYnqQuaucjY7YZ1n6N_EKadx65M0W2XlMA-a8WsewJJek9lJjcGAd0_aaR9SCZC1zmH-yEWz_C82wSNkMsy9Cmo8 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:17:58.468543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4249e846c5d54876a6ed97678450c1d2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: f7e7ce32b4c0457196c8765d6c5ada7e May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. May 30 12:17:58.470408 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '3cd07025-c284-41b4-89d5-fb7f33d3cce3'} May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:58.471384 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. May 30 12:17:58.473061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.474869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Returning 404 to user: Instance 3cd07025-c284-41b4-89d5-fb7f33d3cce3 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:58.474869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-51cdf323-bc31-4fbb-bac5-ce941a14ee43 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3" status: 404 len: 111 microversion: 2.1 time: 0.030286 May 30 12:17:58.474869 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 569/1177] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:58 2022] GET /compute/v2.1/servers/3cd07025-c284-41b4-89d5-fb7f33d3cce3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:17:58.911338 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:58.911961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:58.918771 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.919224 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.920023 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.920464 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.935419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.wsgi [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] HTTP exception thrown: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Request method failure captured: May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: request: DELETE /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b HTTP/1.1 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept: application/json May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Accept-Encoding: identity May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Connection: close May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Length: 0 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Content-Type: application/json May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Host: 10.222.0.41 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Openstack-System-Scope: None May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: User-Agent: python-urllib3/1.26.9 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Auth-Token: gAAAAABilLPaiUo-iZsI3esD_Btcj0msMfUq7z2Im8pUhaM79a_hdPprYsxdvvKz16SA4GVq0dWoP5PbqNXVudvKetykpubpYnqQuaucjY7YZ1n6N_EKadx65M0W2XlMA-a8WsewJJek9lJjcGAd0_aaR9SCZC1zmH-yEWz_C82wSNkMsy9Cmo8 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Id: None May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Domain-Name: None May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Identity-Status: Confirmed May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Is-Admin-Project: True May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Id: default May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Domain-Name: Default May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Project-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Role: member,reader May 30 12:17:58.937038 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Roles: member,reader May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4249e846c5d54876a6ed97678450c1d2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Id: default May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Domain-Name: Default May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Id: f7e7ce32b4c0457196c8765d6c5ada7e May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: X-User-Name: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: method: > May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: exception: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.939181 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: action_args: {'id': '6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b'} May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:58.940188 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.941523 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: ERROR nova.api.openstack.wsgi May 30 12:17:58.942894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Returning 404 to user: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. {{(pid=117705) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:58.942894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-16b4f085-840a-4daf-9df4-3262fa6a0081 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "DELETE /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 404 len: 111 microversion: 2.1 time: 0.031946 May 30 12:17:58.942894 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 609/1178] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:17:58 2022] DELETE /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:17:58.947600 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:17:58.948249 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] [instance: 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:17:58.954955 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.955405 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.956195 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:17:58.956634 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:17:58.969659 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] HTTP exception thrown: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Request method failure captured: May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b HTTP/1.1 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLPaiUo-iZsI3esD_Btcj0msMfUq7z2Im8pUhaM79a_hdPprYsxdvvKz16SA4GVq0dWoP5PbqNXVudvKetykpubpYnqQuaucjY7YZ1n6N_EKadx65M0W2XlMA-a8WsewJJek9lJjcGAd0_aaR9SCZC1zmH-yEWz_C82wSNkMsy9Cmo8 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:17:58.971148 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_4249e846c5d54876a6ed97678450c1d2", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/4249e846c5d54876a6ed97678450c1d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: 4249e846c5d54876a6ed97678450c1d2 May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestVolumeBootPattern-1448383181 May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: f7e7ce32b4c0457196c8765d6c5ada7e May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestVolumeBootPattern-1448383181-project May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.972663 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b'} May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:17:58.973647 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. May 30 12:17:58.975187 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:17:58.977410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Returning 404 to user: Instance 6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:17:58.977410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-929bb623-c896-499d-be99-b19b8fe0fa83 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b" status: 404 len: 111 microversion: 2.1 time: 0.028784 May 30 12:17:58.977410 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 570/1179] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:17:58 2022] GET /compute/v2.1/servers/6a63b722-96ce-4eed-bd32-2ad4fcc5ce6b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:18:00.443231 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-81e8631b-0b26-45cc-9c37-acd4ef0d6039 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] Calling method '.version_select at 0x7f61a1efa1f0>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:18:00.461589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-81e8631b-0b26-45cc-9c37-acd4ef0d6039 tempest-TestVolumeBootPattern-1448383181 tempest-TestVolumeBootPattern-1448383181-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-261961072" status: 202 len: 0 microversion: 2.1 time: 0.021948 May 30 12:18:00.465507 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 610/1180] 10.222.0.41 () {58 vars in 1259 bytes} [Mon May 30 12:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-261961072 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:18:20.585394 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:18:20.586075 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Mon May 30 12:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:19:22.886750 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=18 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:22.887599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=30 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:22.891959 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:19:22.892599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:22.899773 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:22.900245 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:22.900996 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:22.901429 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:22.925110 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.objects.instance [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lazy-loading 'flavor' on Instance uuid 70e90359-563a-4cf6-94b6-1655d0786b88 {{(pid=117706) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 30 12:19:22.997358 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-bf55986e-70ce-421e-955b-67baa13ea6f2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "POST /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88/action" status: 202 len: 0 microversion: 2.1 time: 0.112122 May 30 12:19:22.997975 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 571/1181] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:19:22 2022] POST /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:19:23.004396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:23.005215 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:19:23.010070 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:23.010622 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:23.020710 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:23.021168 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:23.021941 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:23.022376 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:23.155033 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:23.162998 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2fad7862-762f-4b0d-941d-a546788efa96 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.160793 May 30 12:19:23.163551 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 611/1182] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:23 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:24.181677 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:24.182387 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:24.188546 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:24.189003 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:24.190376 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:24.190818 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:24.319234 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:24.327050 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-1d4b3791-8957-4be4-96c6-392216459c7f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.150167 May 30 12:19:24.327624 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 572/1183] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:24 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:25.344061 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:25.344664 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:25.351475 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:25.351943 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:25.352693 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:25.353124 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:25.485699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:25.493611 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-88194b46-344c-4627-b0b8-beeaa401f03d tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.153461 May 30 12:19:25.494180 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 612/1184] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:25 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:26.511273 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:26.511919 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:26.519010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:26.519459 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:26.520272 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:26.520752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:26.654312 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:26.661790 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f677b8c9-6e77-48d5-855f-510ce062caba tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.154390 May 30 12:19:26.662354 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 573/1185] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:26 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:27.679268 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:27.679898 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:27.686375 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:27.686820 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:27.687576 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:27.688045 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:27.820074 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:27.827570 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-b9ec5162-b3c7-45d8-a984-dbc7f8dd11e4 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.152193 May 30 12:19:27.828176 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 613/1186] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:27 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:28.845073 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:28.846314 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:28.852752 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:28.853201 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:28.853960 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:28.854397 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:28.982871 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:28.990979 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-58a9505f-8893-4973-98aa-48bff0d4836a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.149742 May 30 12:19:28.991543 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 574/1187] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:28 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:30.008107 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:30.008728 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:30.015279 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:30.015727 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:30.016529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:30.016969 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:30.158821 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:30.166589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-d71c4521-1306-4e07-a499-0ad9578430bb tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.162359 May 30 12:19:30.167160 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 614/1188] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:30 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:31.183349 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:31.183995 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:31.190552 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:31.190999 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:31.191761 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:31.192223 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:31.326420 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:31.334013 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b2bca766-3259-4bef-8e87-6a36066cc015 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.154492 May 30 12:19:31.334581 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 575/1189] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:31 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:32.351581 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:32.352228 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:32.358893 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:32.359344 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:32.360147 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:32.360589 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:32.495239 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:32.502833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-cf774f09-f805-4cf8-ab31-5274ed8bc454 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.155322 May 30 12:19:32.503402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 615/1190] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:32 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:33.519591 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:33.520226 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:33.526855 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:33.527299 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:33.528086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:33.528529 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:33.724015 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:33.731533 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fdd031b2-a716-407a-b978-3bdb558feacc tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.216376 May 30 12:19:33.732133 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 576/1191] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:33 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:34.754402 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:34.755014 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:34.761623 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:34.762069 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:34.762833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:34.763269 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:34.893485 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:34.900875 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1610bf8f-e52b-4fa7-889b-b3a5f84108f1 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.150433 May 30 12:19:34.901442 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 616/1192] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:34 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:35.917614 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:35.918220 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:35.925474 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:35.925928 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:35.926698 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:35.927471 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:36.058895 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:36.067125 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-f12788e2-6786-4429-80ef-5a8940df2340 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1570 microversion: 2.1 time: 0.153366 May 30 12:19:36.067694 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 577/1193] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:35 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:36.083316 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:19:36.083937 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:36.090307 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:36.090750 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:36.091498 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:36.091961 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:36.385708 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-f6cb7b76-4dad-40be-b644-3528a5652f5c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "POST /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88/action" status: 202 len: 0 microversion: 2.1 time: 0.306545 May 30 12:19:36.386328 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 617/1194] 10.222.0.41 () {60 vars in 1277 bytes} [Mon May 30 12:19:36 2022] POST /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:19:36.394859 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:36.395592 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:36.401593 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:36.402053 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:36.402825 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:36.403265 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:36.576744 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:36.584938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-c416b545-a74d-42ee-91f8-b3ebe5ea6e9c tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1518 microversion: 2.1 time: 0.194278 May 30 12:19:36.585676 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 578/1195] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:36 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:19:37.603213 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:37.603744 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:37.609904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:37.613825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:37.613825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:37.613825 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:37.749580 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:37.758326 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-1ebb6776-233e-4a56-9b44-10db35d18f0f tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1520 microversion: 2.1 time: 0.159706 May 30 12:19:37.758904 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 618/1196] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:37 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:38.776589 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:38.777203 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:38.783783 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:38.784383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:38.785134 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:38.785565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:38.940153 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:38.947633 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-6b611a61-8c5b-4d53-bab8-ab3169ff95ea tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.175468 May 30 12:19:38.948233 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 579/1197] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:38 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:39.965024 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:39.965673 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:39.972185 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:39.972636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:39.973406 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:39.974098 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:40.104206 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:40.111636 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ae6988df-3b51-4fd1-9f1c-58559a703a1a tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.150376 May 30 12:19:40.112786 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 619/1198] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:39 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:40.208540 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-2a7d34aa-25a5-4ac3-ad02-96d21f09335f req-a7e39e92-27e9-4c08-8c2d-7c663affcfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "name": "network-vif-unplugged", "status": "completed", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:19:40.216449 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2a7d34aa-25a5-4ac3-ad02-96d21f09335f req-a7e39e92-27e9-4c08-8c2d-7c663affcfda service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:40.217010 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-2a7d34aa-25a5-4ac3-ad02-96d21f09335f req-a7e39e92-27e9-4c08-8c2d-7c663affcfda service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:40.228632 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-2a7d34aa-25a5-4ac3-ad02-96d21f09335f req-a7e39e92-27e9-4c08-8c2d-7c663affcfda service nova] Creating event network-vif-unplugged:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:19:40.233522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-2a7d34aa-25a5-4ac3-ad02-96d21f09335f req-a7e39e92-27e9-4c08-8c2d-7c663affcfda service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087866 May 30 12:19:40.234103 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 580/1199] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:19:41.129951 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:41.130486 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:41.136924 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:41.137365 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:41.138115 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:41.138545 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:41.269437 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:41.276939 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-5fab85dc-bae5-4fd7-b104-332af0ca36c2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.151706 May 30 12:19:41.277502 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 620/1200] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:41 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:42.294654 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:42.295360 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:42.301715 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:42.302168 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:42.302935 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:42.303377 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:42.433330 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:42.441460 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-89f62969-fc9e-4b0c-8e10-d0254f013d89 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.151477 May 30 12:19:42.442023 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 581/1201] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:42 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:43.458823 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:43.459436 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:43.465885 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:43.466331 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:43.467099 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:43.467529 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:43.597419 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:43.605221 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-2989e52f-1c82-4258-adea-f086fb0a28fa tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.150827 May 30 12:19:43.605792 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 621/1202] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:43 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:44.622726 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:44.623342 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:44.630324 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:44.630768 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:44.631522 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:44.631992 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:44.764472 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:44.772413 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-fa846422-2ca6-4a22-9c0d-2b50b19898b2 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.153435 May 30 12:19:44.773403 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 582/1203] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:44 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:45.789846 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:45.790460 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:45.797022 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:45.797585 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:45.798352 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:45.798783 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:45.934140 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:45.942037 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ad2990fd-bb67-44a6-bf90-03946a2430e3 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1576 microversion: 2.1 time: 0.156179 May 30 12:19:45.942601 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 622/1204] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:45 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:46.958477 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:19:46.959127 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:19:46.965607 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:46.966061 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:46.966833 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:46.967370 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:47.101274 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:19:47.108822 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-b01cad48-964a-4b9b-9ca9-43f009ed0123 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1563 microversion: 2.1 time: 0.154282 May 30 12:19:47.109379 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 583/1205] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:19:46 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:19:48.224392 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-37251a6f-5b3c-48c2-9f70-2be3441877b6 req-30eeb62f-432b-42f2-8344-dedc1ba0b703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "name": "network-vif-plugged", "status": "completed", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:19:48.233385 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-37251a6f-5b3c-48c2-9f70-2be3441877b6 req-30eeb62f-432b-42f2-8344-dedc1ba0b703 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:19:48.233833 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-37251a6f-5b3c-48c2-9f70-2be3441877b6 req-30eeb62f-432b-42f2-8344-dedc1ba0b703 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:19:48.249906 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-37251a6f-5b3c-48c2-9f70-2be3441877b6 req-30eeb62f-432b-42f2-8344-dedc1ba0b703 service nova] Creating event network-vif-plugged:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:19:48.255361 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-37251a6f-5b3c-48c2-9f70-2be3441877b6 req-30eeb62f-432b-42f2-8344-dedc1ba0b703 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035796 May 30 12:19:48.256353 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 623/1206] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:20:12.629890 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:20:12.630520 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:20:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:20:25.003957 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:20:25.004664 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:20:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:21:03.655605 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_api:SELECT=26 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:03.656594 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG dbcounter [-] [117706] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:03.662306 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:03.662778 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:03.663223 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [req-8db49be8-a8c1-437b-b47c-3a1baa90e50d req-e65e0b62-a00d-4b92-b953-cb1911111eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:03.669114 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_api:SELECT=28 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:03.670002 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG dbcounter [-] [117705] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117705) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 30 12:21:03.671107 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:03.671599 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.672709 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:03.673693 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.675977 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8db49be8-a8c1-437b-b47c-3a1baa90e50d req-e65e0b62-a00d-4b92-b953-cb1911111eac service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:03.676445 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [req-8db49be8-a8c1-437b-b47c-3a1baa90e50d req-e65e0b62-a00d-4b92-b953-cb1911111eac service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.693699 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.compute.server_external_events [req-8db49be8-a8c1-437b-b47c-3a1baa90e50d req-e65e0b62-a00d-4b92-b953-cb1911111eac service nova] Creating event network-changed:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:21:03.698985 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [req-8db49be8-a8c1-437b-b47c-3a1baa90e50d req-e65e0b62-a00d-4b92-b953-cb1911111eac service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041738 May 30 12:21:03.700054 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 624/1207] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 30 12:21:03.703932 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Going to try to terminate instance {{(pid=117706) delete /opt/stack/nova/nova/compute/api.py:2664}} May 30 12:21:03.798751 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-9919cb5a-a3f7-44c3-8e65-9e1a61ca2535 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "DELETE /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 204 len: 0 microversion: 2.1 time: 0.144917 May 30 12:21:03.800316 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 584/1208] 10.222.0.41 () {58 vars in 1238 bytes} [Mon May 30 12:21:03 2022] DELETE /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 30 12:21:03.809526 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:03.810226 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:03.816836 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:03.817294 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.818062 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:03.818499 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:03.951167 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:03.958883 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-ccbe658e-71ff-4807-afe1-21f31f6f00b9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.154053 May 30 12:21:03.959536 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 625/1209] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:21:03 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 30 12:21:04.977296 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:04.977913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:04.984478 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:04.984922 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:04.985680 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:04.986117 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:05.187673 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.policy [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117706) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:05.195963 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-172c2b59-39f1-48dc-84be-3e30d7ead7a9 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1569 microversion: 2.1 time: 0.223199 May 30 12:21:05.196523 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 585/1210] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:21:04 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:06.213616 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:06.214318 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.compute.api [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117705) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:06.221013 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:06.222083 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:06.223280 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:06.223787 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG oslo_concurrency.lockutils [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117705) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:06.250383 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [req-a54e889b-0c53-4568-a9b5-7836f223c45d req-fb4e0afc-3d3a-4a27-a663-f8050cd47ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e90359-563a-4cf6-94b6-1655d0786b88", "name": "network-vif-deleted", "tag": "c8a260ad-db40-403f-a26f-2c956124d99b"}]} {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 30 12:21:06.259984 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a54e889b-0c53-4568-a9b5-7836f223c45d req-fb4e0afc-3d3a-4a27-a663-f8050cd47ff9 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:06.260525 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [req-a54e889b-0c53-4568-a9b5-7836f223c45d req-fb4e0afc-3d3a-4a27-a663-f8050cd47ff9 service nova] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:06.272913 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.compute.server_external_events [req-a54e889b-0c53-4568-a9b5-7836f223c45d req-fb4e0afc-3d3a-4a27-a663-f8050cd47ff9 service nova] Creating event network-vif-deleted:c8a260ad-db40-403f-a26f-2c956124d99b for instance 70e90359-563a-4cf6-94b6-1655d0786b88 on hv-cinder-83979 May 30 12:21:06.277644 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [req-a54e889b-0c53-4568-a9b5-7836f223c45d req-fb4e0afc-3d3a-4a27-a663-f8050cd47ff9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031088 May 30 12:21:06.278503 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 586/1211] 10.222.0.41 () {64 vars in 1317 bytes} [Mon May 30 12:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 30 12:21:06.297404 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.policy [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0eb80aad1ad74eb4b0a28b1e686ecfab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc29531ccae24475ab6b50e2cc2e5d48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117705) authorize /opt/stack/nova/nova/policy.py:199}} May 30 12:21:06.304956 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-6fa001aa-437b-47ea-aa38-941364e16086 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 200 len: 1383 microversion: 2.1 time: 0.095440 May 30 12:21:06.305516 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 626/1212] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:21:06 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 1383 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 30 12:21:07.322938 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '>' {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:07.323638 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.compute.api [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] [instance: 70e90359-563a-4cf6-94b6-1655d0786b88] Fetching instance by UUID {{(pid=117706) get /opt/stack/nova/nova/compute/api.py:2920}} May 30 12:21:07.329859 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:07.330248 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:07.331086 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 30 12:21:07.331521 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG oslo_concurrency.lockutils [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Lock "975509b8-a7ed-4f66-b307-9619b582ed41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 30 12:21:07.344565 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.wsgi [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] HTTP exception thrown: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Request method failure captured: May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: request: GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 HTTP/1.1 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept: application/json May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Accept-Encoding: identity May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Connection: close May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Length: 0 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Content-Type: application/json May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Host: 10.222.0.41 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Openstack-System-Scope: None May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: User-Agent: python-urllib3/1.26.9 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Auth-Token: gAAAAABilLWrF3b4li6kc1VQYnb4Es0NYFIcSa9gxeEBhAARSYcTqganq1tQ8PC39n2MoGJQYI0TQrrY0hQHdd9k8GmQhBynqO6lzPAsHJZnJB4CB4E1fZFUQNaIavqJPLcx1SZCy4nb0g7UJBEzVeRrtSFbrggMtgU0QiT8EZbuoWOm7uHzmok May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Id: None May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Domain-Name: None May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Identity-Status: Confirmed May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Is-Admin-Project: True May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Id: default May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Domain-Name: Default May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Id: cc29531ccae24475ab6b50e2cc2e5d48 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Project-Name: tempest-TestShelveInstance-1659377078 May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Role: member,reader May 30 12:21:07.346860 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Roles: member,reader May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2/cc29531ccae24475ab6b50e2cc2e5d48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:8080/v1/AUTH_cc29531ccae24475ab6b50e2cc2e5d48", "adminURL": "http://10.222.0.41:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc29531ccae24475ab6b50e2cc2e5d48"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/volume/v3/cc29531ccae24475ab6b50e2cc2e5d48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.41/image"}]}] May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant: tempest-TestShelveInstance-1659377078 May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Id: cc29531ccae24475ab6b50e2cc2e5d48 May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-Tenant-Name: tempest-TestShelveInstance-1659377078 May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User: tempest-TestShelveInstance-1659377078-project May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Id: default May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Domain-Name: Default May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Id: 0eb80aad1ad74eb4b0a28b1e686ecfab May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: X-User-Name: tempest-TestShelveInstance-1659377078-project May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: method: > May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: exception: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. May 30 12:21:07.348950 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: action_args: {'id': '70e90359-563a-4cf6-94b6-1655d0786b88'} May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: {{(pid=117706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 30 12:21:07.349893 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. May 30 12:21:07.351318 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: ERROR nova.api.openstack.wsgi May 30 12:21:07.352617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: DEBUG nova.api.openstack.wsgi [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Returning 404 to user: Instance 70e90359-563a-4cf6-94b6-1655d0786b88 could not be found. {{(pid=117706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 30 12:21:07.352617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO nova.api.openstack.requestlog [None req-ee003a28-16b3-48a6-9d44-50d66e4dc181 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88" status: 404 len: 111 microversion: 2.1 time: 0.030319 May 30 12:21:07.352617 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: [pid: 117706|app: 0|req: 587/1213] 10.222.0.41 () {58 vars in 1235 bytes} [Mon May 30 12:21:07 2022] GET /compute/v2.1/servers/70e90359-563a-4cf6-94b6-1655d0786b88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 30 12:21:07.512504 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: DEBUG nova.api.openstack.wsgi [None req-3d34c981-5af3-412c-ba23-2ae1b909e9a6 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] Calling method '.version_select at 0x7f61a1d5f310>' {{(pid=117705) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 30 12:21:07.530971 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO nova.api.openstack.requestlog [None req-3d34c981-5af3-412c-ba23-2ae1b909e9a6 tempest-TestShelveInstance-1659377078 tempest-TestShelveInstance-1659377078-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1626932515" status: 202 len: 0 microversion: 2.1 time: 0.022517 May 30 12:21:07.531713 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: [pid: 117705|app: 0|req: 627/1214] 10.222.0.41 () {58 vars in 1253 bytes} [Mon May 30 12:21:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1626932515 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 30 12:23:32.638284 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:23:32.638909 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:23:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:23:45.012355 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:23:45.013066 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:23:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:23:46.579491 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:23:46.580184 dv-cinder-839793-13-iscsi devstack@n-api.service[117706]: Mon May 30 12:23:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 30 12:25:00.597396 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 30 12:25:00.598010 dv-cinder-839793-13-iscsi devstack@n-api.service[117705]: Mon May 30 12:25:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!